-- Logs begin at Wed 2021-12-15 12:56:27 UTC, end at Wed 2021-12-15 13:53:26 UTC. -- Dec 15 13:22:58.214802 dv-cinder-813228-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 13:22:58 2021] *** Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: nodename: dv-cinder-813228-4-iscsi Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: machine: x86_64 Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: clock source: unix Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: pcre jit disabled Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: detected number of CPU cores: 4 Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: current working directory: / Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: detected binary path: /usr/bin/uwsgi-core Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: your processes number limit is 47680 Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: your memory page size is 4096 bytes Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: detected max file descriptor number: 2048 Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: lock engine: pthread robust mutexes Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: thunder lock: enabled Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 15 13:22:58.229463 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 13:22:58.272888 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: Python main interpreter initialized at 0x55efaa9a09c0 Dec 15 13:22:58.272888 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: python threads support enabled Dec 15 13:22:58.272888 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: your server socket listen backlog is limited to 100 connections Dec 15 13:22:58.272888 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: your mercy for graceful operations on workers is 90 seconds Dec 15 13:22:58.273248 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 13:22:58.273325 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: *** Operational MODE: preforking *** Dec 15 13:22:58.273615 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: *** uWSGI is running in multiple interpreter mode *** Dec 15 13:22:58.273615 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: spawned uWSGI master process (pid: 79126) Dec 15 13:22:58.273855 dv-cinder-813228-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 15 13:22:58.275271 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: spawned uWSGI worker 1 (pid: 79139, cores: 1) Dec 15 13:22:58.275271 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: spawned uWSGI worker 2 (pid: 79140, cores: 1) Dec 15 13:22:58.275271 dv-cinder-813228-4-iscsi devstack@keystone.service[79126]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 13:23:03.574844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:23:03.574844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: from cryptography.utils import int_from_bytes Dec 15 13:23:03.576087 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:23:03.576087 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: from cryptography.utils import int_from_bytes Dec 15 13:23:03.576202 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:23:03.576202 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: from cryptography.utils import int_from_bytes Dec 15 13:23:03.576202 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:23:03.576202 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: from cryptography.utils import int_from_bytes Dec 15 13:23:03.625327 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:23:03.625555 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:23:03.625676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:23:03.625840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:23:03.625949 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] command line args: [] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:23:03.626050 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] command line args: [] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:23:03.626160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:23:03.626266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:23:03.626364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ================================================================================ {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:23:03.626469 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ================================================================================ {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:23:03.626590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] admin_token = **** {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.626695 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] admin_token = **** {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.626803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] config_dir = [] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.626909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] config_dir = [] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.627044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.627147 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.627238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] config_source = [] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.627366 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] config_source = [] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.627463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] debug = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.627549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] debug = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.627656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.628167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.628167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.628465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.628611 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.628747 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.628889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.629024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.629169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.629298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.629450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] list_limit = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.629594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] list_limit = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.629748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] log_config_append = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.629942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] log_config_append = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.630103 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.630265 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.630423 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] log_dir = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.630573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] log_dir = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.630724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] log_file = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.630879 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] log_file = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.631310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.631583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.631828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.632218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.632505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.632800 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.633096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.633406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.633723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.634030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.634338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.634653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.634957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.635277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.635613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.635998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.636300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.636559 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.636780 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.637010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.637196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.637411 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.637592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.637808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.637945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.638114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.638228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.638341 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.638454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.638564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.638675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.638801 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.638908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] publish_errors = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.639030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] publish_errors = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.639143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.639259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.639388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.639503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.639618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.639741 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.639845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.640037 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.640151 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.640271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.640377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] standard_threads = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.640484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] standard_threads = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.640602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.640717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.640822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.640946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.641058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.641169 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.641277 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] use_journal = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.641392 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] use_journal = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.641508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] use_json = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.641625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] use_json = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.641738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] use_stderr = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.641882 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] use_stderr = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.641996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] use_syslog = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.642153 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] use_syslog = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.642265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.642388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:23:03.642503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.642610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.642727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.642848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.642963 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.643080 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.643193 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.643298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.643416 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.643583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.643702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.643903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.644019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.644125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.644244 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.644350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.644460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.644587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.644693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.644802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.644911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.645020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.645138 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.645260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.645372 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.645478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.645598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.645710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.645857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.645981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.646091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.646091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.646300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.646300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.646510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.646510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.646720 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.646829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.646936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.647043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.647152 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.647274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.647432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.647537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.647655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.647782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.647902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.648015 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.648121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.648239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.648362 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.648471 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.648595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.648702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.648809 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.648919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.649026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.649149 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.649333 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.649449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.649564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.649677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.649820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.649980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.650134 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.650280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.650423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.650563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.650700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.650858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.651016 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.651183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.651338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.651481 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.651613 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.651748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.652256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.652389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.652522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.652663 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.652799 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.652927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.653068 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.653205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.653334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.653474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.653622 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.653827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.654014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.654175 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.654339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.654496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.654657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.654809 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.654979 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.655135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.655287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.655512 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.655677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.655837 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.656051 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.656227 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.656386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.656553 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.656708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.656864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.657825 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.657994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.658151 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.658300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.658472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.658648 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.658828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.658990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.659136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.659254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.659393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.659562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.659693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.659858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.659968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.660134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.660241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.660407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.660543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.660710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.660821 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.660957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.661122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.661229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.661407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.661513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.661683 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.661864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.662033 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.662139 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.662278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.662448 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.662563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.662731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.662838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.663015 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.663132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.663298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.663405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.663524 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.663694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.663809 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.664442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.664628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.664808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.664924 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.665043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.665162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.665350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.665457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.665569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.665691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.665816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.665936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.666062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.666178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.666285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.666395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.666510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.666628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.666754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.666860 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.666969 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.667087 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.667192 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.667313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.667440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.667547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.667670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.667793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.667910 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.668022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.668142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.668259 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.668367 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.668543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.668655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.668778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.668899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.669018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.669134 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.669242 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] auth.external = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.669378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.669541 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.669661 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] auth.external = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.669827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.669951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.670074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.670190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.670300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] auth.password = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.670419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.670542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] auth.token = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.670649 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] auth.password = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.670760 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.670870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] auth.token = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.670988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.671095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.671217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.671327 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.671446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.671553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.671673 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.671780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.671902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.672009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.672119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.672239 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.672384 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] credential.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.672506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.672615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.672742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] credential.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.672861 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.672974 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.673086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.673205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.673313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.673422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.673545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.673653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.673782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.673897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.674011 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.674121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.674248 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.674356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.674476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.674589 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.674701 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.674818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.674943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.675051 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.675162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.675271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.675382 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.675493 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.675613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.675613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.675818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.675927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] federation.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.676043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.676153 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.676309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.676419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.676532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] federation.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.676643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.676754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.676865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.677007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.677167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.677283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.677394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.677506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.677626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.677819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.677932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.678064 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.678183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.678298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.678424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.678546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.678657 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.678772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.678889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.679002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.679196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.679306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.679430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.679577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.680215 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.680332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.680463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.680578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.680701 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.680819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.680937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.681053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.681184 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.681316 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.681428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.681547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.681669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.681802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.681945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.682056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.682175 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.682293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.682413 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.682787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.682917 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.683032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.683150 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.683267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.683386 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.683510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.683638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.683754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.683881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.683996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.684118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.684233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.684362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.684479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.684598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.684598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.684815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.684933 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.685067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.685185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.685303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.685420 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.685536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.685655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.685843 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.685954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.686072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.686072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.686294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.686412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.686547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.686660 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.686781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.686896 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.687033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.687145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.687274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.687388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.687507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.687507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.687726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.687726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.687961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.687961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.688167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.688281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.688404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.688521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.688651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.688765 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.688884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.689001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.689120 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.689237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.689368 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.689490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.689607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.689735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.689913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.690021 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.690161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.690273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.690388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.690503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.690621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.690781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.690915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.691031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.691150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.691268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.691387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.691517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.691635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.691758 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.691877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.691994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.692112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.692243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.692358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.692477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.692598 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.692717 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.692844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.692971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.693087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.693205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.693324 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.693447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.693574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.693698 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.693841 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.693961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.694080 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.694211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.694328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.694458 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.694574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.694693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.694812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.694932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.695053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.695186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.695299 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.695408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.695521 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.695639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.695759 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.695895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.696009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.696126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.696245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.696363 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.696481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.696610 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.696731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.696850 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.696968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.697086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.697204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.697344 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.697454 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.697563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.697683 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.697841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.697953 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.698086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.698196 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.698311 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.698430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.698544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.698659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.698786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.698897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.699012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.699127 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.699251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.699363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.699490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.699599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.699715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.699830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.699942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.700061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.700188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.700299 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.700414 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.700526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.700641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.700755 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.700881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] resource.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.700992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.701106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.701221 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.701334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.701450 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.701581 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.701690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] resource.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.701820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.701959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.702069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.702186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.702314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.702427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.702552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.702666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.702782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.702899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.703096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.703207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.703329 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] role.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.703446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.703561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] role.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.703679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.703806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.703927 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.704043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.704157 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] role.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.704273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.704400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] role.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.704513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.704630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.704739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.704861 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.704984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.705114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.705231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.705348 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.705468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.705586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.705705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.705869 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.705978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.706098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.706218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.706336 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.706456 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.706602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.706713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.706832 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.706949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.707069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.707069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.707291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.707404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.707522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.707639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.707757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.707757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.707988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.708105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.708222 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.708340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.708459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.708579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.708711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.708825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.708944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.709061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.709178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.709297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.709425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.709551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.709678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.709849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.709960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.710094 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.710204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.710318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.710433 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.710548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.710661 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.710788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.710899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.711014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.711141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.711259 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.711382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.711504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.711618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.711736 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] token.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.711859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.711971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.712084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.712210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.712320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.712435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.712549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] token.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.712662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.712777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.712908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.713018 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.713134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.713248 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.713363 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.713478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.713605 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.713716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.713852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.713970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.714087 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.714203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.714336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.714447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.714569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.714685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.714801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.714917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.715046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.715158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.715267 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.715375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.715490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.715606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.715733 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.715845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.715964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.connection = **** {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.716080 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.716199 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.716456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.716613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.716731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.716848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.716966 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.connection = **** {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.717085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.717203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.717335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.717450 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.717568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.717685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.717950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.718059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.718197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.718308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.718426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.718542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.718657 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.718787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.718913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.719053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.719166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.719274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.719382 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.719497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.719629 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.719759 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.719873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.720007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.720157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.720269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.720399 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.720512 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.720622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.720622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:23:03.720862 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.720862 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.720862 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.720862 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:23:03.720862 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:23:03.737858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.738084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.738303 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.744672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.744903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.745132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.747595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.753900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.777709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.777993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.782166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.782400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.831074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.831378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.881191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.881524 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.881665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.881877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.949458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.949731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.949919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.950010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.950088 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.950162 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.950315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.950399 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.950530 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.950613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.950746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.950959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.974239 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.974471 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.974599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.974731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.974846 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.974928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.975013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.975089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.975161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.975248 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.975373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.975498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.975636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.975738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.987406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:03.987539 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.000239 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.000435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.000571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.000739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.000862 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.000994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.001141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.001264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.001391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.001514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.001637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.001782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.001954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.002068 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 13:23:04.018568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.018772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 13:23:04.019083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.019215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.019296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 13:23:04.019371 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 13:23:04.019555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.019637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.019800 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 13:23:04.019918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.020061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.020155 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.020312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.020404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.020561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.020808 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.031360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.031637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.031829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.031902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.032101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.032175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.032414 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.032643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.040820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.041268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.044137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.044416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.044505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.044695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.044798 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.044975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.045065 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.045256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.045346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.045515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.045607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.045777 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.045867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.046047 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.046136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.046312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.046401 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.046571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.046660 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.046833 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.046929 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.047091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.073107 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.073218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.074705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.074812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.074980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.075070 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.080101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.080200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.082200 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.082308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.082445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.082564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.090143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.090249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.090418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.090511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.094767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.094863 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.095046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.095144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.095510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.095614 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.095691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.095936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.096019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.096104 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.096181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.096256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.096330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.096404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.096590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.096677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.115407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.115516 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.115669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.115770 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.120148 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.120250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.123736 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.123867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.124124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.124264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.129042 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.129188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.132568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.133294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.136632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.136871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.136955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.137166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.137317 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.137464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.137594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.137733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.137891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.138022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.138164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.138327 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.157128 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.157400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.157605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.157749 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.157902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.158028 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.158155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.158410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.165632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.166191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.167332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.167598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.167875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.168148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.170700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.170972 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.171241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.171369 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.171526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.171677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.171807 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.171937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.172070 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.172352 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.184985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.185252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.185530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.185664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.185838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.185970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.186181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.186313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.186445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.186576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.186722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.186874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.187085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.187361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.204834 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.205555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.208011 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.208768 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.211783 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.212659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.213456 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.214388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.215081 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.215362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.215635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.215993 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.216276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.216554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.222744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.223731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.224302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.225298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.227479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.227767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.228154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.228435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.228576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.228764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.229154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.229444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.237425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.237728 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.238084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.238615 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.239039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.239446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.245773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.246053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.246325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.246592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.246865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.247231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 13:23:04.247314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.247507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.247591 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.247771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.247853 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.248035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.248125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.248297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.248379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.248574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.248677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.248849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.248965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.249117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.249245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.249369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.249514 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.249809 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.250092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.250370 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.250643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.250904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 13:23:04.287980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55efaa9a09c0 pid: 79139 (default app) Dec 15 13:23:04.289328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55efaa9a09c0 pid: 79140 (default app) Dec 15 13:23:04.291591 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc2bd-8e71-4841-bc7f-14d0497eeec1 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:04.291881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc2bd-8e71-4841-bc7f-14d0497eeec1 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:04.292410 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc2bd-8e71-4841-bc7f-14d0497eeec1 None None] PATH_INFO: `/v3` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:04.296338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 791 bytes} [Wed Dec 15 13:23:04 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:12.171111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e5391-bc16-4118-be21-4b4f7303b08e None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:12.171638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e5391-bc16-4118-be21-4b4f7303b08e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:12.171638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e5391-bc16-4118-be21-4b4f7303b08e None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:12.176716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1/2] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:12 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:23:12.183771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9aeed-4ad2-47e5-8326-6f9d6c062c56 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:12.184172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9aeed-4ad2-47e5-8326-6f9d6c062c56 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:12.184324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9aeed-4ad2-47e5-8326-6f9d6c062c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:12.217547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG oslo_db.sqlalchemy.engines [None req-ebd9aeed-4ad2-47e5-8326-6f9d6c062c56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79139) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:23:12.430841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG passlib.handlers.bcrypt [None req-ebd9aeed-4ad2-47e5-8326-6f9d6c062c56 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79139) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 13:23:12.431177 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG passlib.handlers.bcrypt [None req-ebd9aeed-4ad2-47e5-8326-6f9d6c062c56 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79139) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 13:23:12.487385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-ebd9aeed-4ad2-47e5-8326-6f9d6c062c56 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:12.488979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ebd9aeed-4ad2-47e5-8326-6f9d6c062c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:12.622133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 2/3] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:12.844280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e5391-bc16-4118-be21-4b4f7303b08e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:12.878916 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG oslo_db.sqlalchemy.engines [None req-252e5391-bc16-4118-be21-4b4f7303b08e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:23:13.008641 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e5391-bc16-4118-be21-4b4f7303b08e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:13.015797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1619d-fe16-4304-aee8-9cb678cfd04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:13.016731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1619d-fe16-4304-aee8-9cb678cfd04c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:13.017099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1619d-fe16-4304-aee8-9cb678cfd04c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:13.017523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1619d-fe16-4304-aee8-9cb678cfd04c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:13.030452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1619d-fe16-4304-aee8-9cb678cfd04c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:13.081837 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d3c1619d-fe16-4304-aee8-9cb678cfd04c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 13:23:13.082167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1619d-fe16-4304-aee8-9cb678cfd04c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:13.092858 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 2/4] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:23:13.100214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9aeed-4ad2-47e5-8326-6f9d6c062c56 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:13.115488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9aeed-4ad2-47e5-8326-6f9d6c062c56 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:13.120053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde67e1-869c-42ec-b705-a6ef178f7800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:13.121202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde67e1-869c-42ec-b705-a6ef178f7800 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:13.121488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde67e1-869c-42ec-b705-a6ef178f7800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:13.121776 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde67e1-869c-42ec-b705-a6ef178f7800 admin admin] PATH_INFO: `/v3/projects/0f70e030dc594b37825ba3900598d4c4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:13.123342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde67e1-869c-42ec-b705-a6ef178f7800 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f70e030dc594b37825ba3900598d4c4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:13.177128 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0dde67e1-869c-42ec-b705-a6ef178f7800 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 13:23:13.177464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde67e1-869c-42ec-b705-a6ef178f7800 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:13.182383 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 3/5] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:13 2021] GET /identity/v3/projects/0f70e030dc594b37825ba3900598d4c4 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:15.598264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aecc5-b6d2-4e8d-82f7-9c61bb514521 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:15.598815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aecc5-b6d2-4e8d-82f7-9c61bb514521 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:15.598815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aecc5-b6d2-4e8d-82f7-9c61bb514521 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:15.603653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 3/6] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:15 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:15.610113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f3a4-a0ee-4ea1-b818-0bb66a9703ed None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:15.610533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f3a4-a0ee-4ea1-b818-0bb66a9703ed None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:15.610670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f3a4-a0ee-4ea1-b818-0bb66a9703ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:15.631027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f0a3f3a4-a0ee-4ea1-b818-0bb66a9703ed None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:15.633169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f0a3f3a4-a0ee-4ea1-b818-0bb66a9703ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:15.641139 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 4/7] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:15.666161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aecc5-b6d2-4e8d-82f7-9c61bb514521 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:15.678235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aecc5-b6d2-4e8d-82f7-9c61bb514521 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:15.682900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27b260-9a3b-476e-83ca-ac3755ba2f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:15.683536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27b260-9a3b-476e-83ca-ac3755ba2f74 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:15.683816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27b260-9a3b-476e-83ca-ac3755ba2f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:15.684090 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27b260-9a3b-476e-83ca-ac3755ba2f74 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:15.691880 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27b260-9a3b-476e-83ca-ac3755ba2f74 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:15.693645 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27b260-9a3b-476e-83ca-ac3755ba2f74 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:15.702843 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 4/8] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:23:15.709198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3f3a4-a0ee-4ea1-b818-0bb66a9703ed None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:15.718989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3f3a4-a0ee-4ea1-b818-0bb66a9703ed None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:15.723365 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de6990-61fd-4b95-b36e-14ec308c9d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:15.724224 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de6990-61fd-4b95-b36e-14ec308c9d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:15.724502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de6990-61fd-4b95-b36e-14ec308c9d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:15.724776 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de6990-61fd-4b95-b36e-14ec308c9d5e admin admin] PATH_INFO: `/v3/users/df51193f4ede4e77a3f00ac4e0205892` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:15.726225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de6990-61fd-4b95-b36e-14ec308c9d5e admin admin] RBAC: Authorizing `identity:get_user(user_id=df51193f4ede4e77a3f00ac4e0205892)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:15.728043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de6990-61fd-4b95-b36e-14ec308c9d5e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:15.729575 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 5/9] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:15 2021] GET /identity/v3/users/df51193f4ede4e77a3f00ac4e0205892 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:18.175215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f8b9-2190-4c39-82d5-c0c4b8398f14 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:18.175754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f8b9-2190-4c39-82d5-c0c4b8398f14 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:18.175754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f8b9-2190-4c39-82d5-c0c4b8398f14 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:18.177509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 5/10] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:18.183558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170144a-8dd0-416b-926f-0c1afd0ac4e6 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:18.183972 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170144a-8dd0-416b-926f-0c1afd0ac4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:18.184106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170144a-8dd0-416b-926f-0c1afd0ac4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:18.201424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-1170144a-8dd0-416b-926f-0c1afd0ac4e6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:18.202638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1170144a-8dd0-416b-926f-0c1afd0ac4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:18.210209 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 6/11] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:18.235159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873f8b9-2190-4c39-82d5-c0c4b8398f14 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:18.247140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873f8b9-2190-4c39-82d5-c0c4b8398f14 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:18.251384 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f79f8-2ecc-447b-9641-cf899c014b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:18.252176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f79f8-2ecc-447b-9641-cf899c014b3a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:18.252456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f79f8-2ecc-447b-9641-cf899c014b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:18.252729 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f79f8-2ecc-447b-9641-cf899c014b3a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:18.269897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f79f8-2ecc-447b-9641-cf899c014b3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:18.277226 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-874f79f8-2ecc-447b-9641-cf899c014b3a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:23:18.278763 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 6/12] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:23:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:23:18.284903 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170144a-8dd0-416b-926f-0c1afd0ac4e6 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:18.294773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170144a-8dd0-416b-926f-0c1afd0ac4e6 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:18.299342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d72b6-b32c-42f9-81a6-36e1f609bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:18.300058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d72b6-b32c-42f9-81a6-36e1f609bae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:18.300500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d72b6-b32c-42f9-81a6-36e1f609bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:18.300787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d72b6-b32c-42f9-81a6-36e1f609bae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:18.301574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d72b6-b32c-42f9-81a6-36e1f609bae1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:18.301931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d72b6-b32c-42f9-81a6-36e1f609bae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:18.303739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-9f1d72b6-b32c-42f9-81a6-36e1f609bae1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:18.303739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:23:18.303739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:23:18.304815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d72b6-b32c-42f9-81a6-36e1f609bae1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:18.320770 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 7/13] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:18.326996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f79f8-2ecc-447b-9641-cf899c014b3a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:18.337320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f79f8-2ecc-447b-9641-cf899c014b3a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:18.341635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298813a5-a62e-4ea6-88a4-d74185eb1113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:18.342519 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298813a5-a62e-4ea6-88a4-d74185eb1113 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:18.342799 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298813a5-a62e-4ea6-88a4-d74185eb1113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:18.343068 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298813a5-a62e-4ea6-88a4-d74185eb1113 admin admin] PATH_INFO: `/v3/users/df51193f4ede4e77a3f00ac4e0205892` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:18.345088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298813a5-a62e-4ea6-88a4-d74185eb1113 admin admin] RBAC: Authorizing `identity:get_user(user_id=df51193f4ede4e77a3f00ac4e0205892)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:18.346950 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298813a5-a62e-4ea6-88a4-d74185eb1113 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:18.348567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 7/14] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:18 2021] GET /identity/v3/users/df51193f4ede4e77a3f00ac4e0205892 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:18.355137 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d72b6-b32c-42f9-81a6-36e1f609bae1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:18.365085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d72b6-b32c-42f9-81a6-36e1f609bae1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:18.369528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6be5-3c38-4a5d-a145-543c80e3f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:18.370358 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6be5-3c38-4a5d-a145-543c80e3f18e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:18.370637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6be5-3c38-4a5d-a145-543c80e3f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:18.370909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6be5-3c38-4a5d-a145-543c80e3f18e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:18.372122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6be5-3c38-4a5d-a145-543c80e3f18e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:18.373872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6be5-3c38-4a5d-a145-543c80e3f18e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:18.375428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 8/15] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:18.382077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298813a5-a62e-4ea6-88a4-d74185eb1113 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:18.394524 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298813a5-a62e-4ea6-88a4-d74185eb1113 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:18.402016 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d8732-20f1-42e9-b7fc-7d018541e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:18.402772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d8732-20f1-42e9-b7fc-7d018541e205 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:18.403061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d8732-20f1-42e9-b7fc-7d018541e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:18.403342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d8732-20f1-42e9-b7fc-7d018541e205 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:18.404197 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d8732-20f1-42e9-b7fc-7d018541e205 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.domain.id=default, user.id=df51193f4ede4e77a3f00ac4e0205892) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:18.404507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d8732-20f1-42e9-b7fc-7d018541e205 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:18.406288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-304d8732-20f1-42e9-b7fc-7d018541e205 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:18.406288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:23:18.406288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:23:18.407451 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d8732-20f1-42e9-b7fc-7d018541e205 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:18.416825 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 8/16] 10.222.0.83 () {56 vars in 1343 bytes} [Wed Dec 15 13:23:18 2021] GET /identity/v3/role_assignments?user.id=df51193f4ede4e77a3f00ac4e0205892&scope.domain.id=default&role.id=a312b345efeb490eb4234d1ace386dec => generated 233 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:18.423962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae637-4001-4a92-a5a3-5d77a77a84f5 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:18.424251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae637-4001-4a92-a5a3-5d77a77a84f5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:18.424526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae637-4001-4a92-a5a3-5d77a77a84f5 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:18.426721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 9/17] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:18.433601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859ca55-cb9b-427d-bb3d-44d62f21bc0f None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:18.433928 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859ca55-cb9b-427d-bb3d-44d62f21bc0f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:18.434212 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859ca55-cb9b-427d-bb3d-44d62f21bc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:18.478167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG passlib.handlers.bcrypt [None req-9859ca55-cb9b-427d-bb3d-44d62f21bc0f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79140) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 13:23:18.478650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG passlib.handlers.bcrypt [None req-9859ca55-cb9b-427d-bb3d-44d62f21bc0f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79140) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 13:23:18.526734 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-9859ca55-cb9b-427d-bb3d-44d62f21bc0f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:18.528412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9859ca55-cb9b-427d-bb3d-44d62f21bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:18.553325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 9/18] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:18.578067 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ae637-4001-4a92-a5a3-5d77a77a84f5 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:18.591472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ae637-4001-4a92-a5a3-5d77a77a84f5 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:18.596134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf4e96-5a81-44dd-8267-e6ac24038593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:18.596796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf4e96-5a81-44dd-8267-e6ac24038593 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:18.597076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf4e96-5a81-44dd-8267-e6ac24038593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:18.597346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf4e96-5a81-44dd-8267-e6ac24038593 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:18.606825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf4e96-5a81-44dd-8267-e6ac24038593 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:18.608702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf4e96-5a81-44dd-8267-e6ac24038593 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:18.619369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 10/19] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:18.626795 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859ca55-cb9b-427d-bb3d-44d62f21bc0f None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:18.641214 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859ca55-cb9b-427d-bb3d-44d62f21bc0f None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:18.646464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbea804-55bb-49eb-bad5-d5fccc95d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:18.647610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbea804-55bb-49eb-bad5-d5fccc95d28a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:18.647965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbea804-55bb-49eb-bad5-d5fccc95d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:18.648244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbea804-55bb-49eb-bad5-d5fccc95d28a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:18.650375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbea804-55bb-49eb-bad5-d5fccc95d28a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:18.652115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbea804-55bb-49eb-bad5-d5fccc95d28a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:18.654110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 10/20] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:21.616896 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddd90b-8142-422f-9f43-7f9a9f5d0311 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:21.617434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddd90b-8142-422f-9f43-7f9a9f5d0311 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:21.617434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddd90b-8142-422f-9f43-7f9a9f5d0311 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:21.619336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 11/21] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:21.625580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9e4f3-a850-4b24-8a96-be75dcd908e7 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:21.626073 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9e4f3-a850-4b24-8a96-be75dcd908e7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:21.626172 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9e4f3-a850-4b24-8a96-be75dcd908e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:21.667471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-83d9e4f3-a850-4b24-8a96-be75dcd908e7 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:21.668984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-83d9e4f3-a850-4b24-8a96-be75dcd908e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:21.680110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 11/22] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:21.717003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddd90b-8142-422f-9f43-7f9a9f5d0311 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:21.731455 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddd90b-8142-422f-9f43-7f9a9f5d0311 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:21.737998 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead13b6-85f9-42ed-b97d-177772ab0522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:21.738941 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead13b6-85f9-42ed-b97d-177772ab0522 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:21.739227 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead13b6-85f9-42ed-b97d-177772ab0522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:21.739507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead13b6-85f9-42ed-b97d-177772ab0522 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:21.755098 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead13b6-85f9-42ed-b97d-177772ab0522 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:21.763500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-0ead13b6-85f9-42ed-b97d-177772ab0522 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:23:21.765215 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 12/23] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:23:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:21.771587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9e4f3-a850-4b24-8a96-be75dcd908e7 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:21.781608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9e4f3-a850-4b24-8a96-be75dcd908e7 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:21.789974 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7e962-1a2c-418e-a72b-cd0a25a69d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:21.790840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7e962-1a2c-418e-a72b-cd0a25a69d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:21.791127 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7e962-1a2c-418e-a72b-cd0a25a69d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:21.791406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7e962-1a2c-418e-a72b-cd0a25a69d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:21.792329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7e962-1a2c-418e-a72b-cd0a25a69d51 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:21.792684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7e962-1a2c-418e-a72b-cd0a25a69d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:21.793877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-43f7e962-1a2c-418e-a72b-cd0a25a69d51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:21.793877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:23:21.793877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:23:21.794798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7e962-1a2c-418e-a72b-cd0a25a69d51 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:21.813732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 12/24] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:21.821252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead13b6-85f9-42ed-b97d-177772ab0522 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:21.832139 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead13b6-85f9-42ed-b97d-177772ab0522 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:21.842109 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdd693-d54c-4a5e-aec5-36aa07fb5290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:21.843279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdd693-d54c-4a5e-aec5-36aa07fb5290 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:21.843560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdd693-d54c-4a5e-aec5-36aa07fb5290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:21.843839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdd693-d54c-4a5e-aec5-36aa07fb5290 admin admin] PATH_INFO: `/v3/users/df51193f4ede4e77a3f00ac4e0205892` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:21.845088 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdd693-d54c-4a5e-aec5-36aa07fb5290 admin admin] RBAC: Authorizing `identity:get_user(user_id=df51193f4ede4e77a3f00ac4e0205892)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:21.847171 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdd693-d54c-4a5e-aec5-36aa07fb5290 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:21.848842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 13/25] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:21 2021] GET /identity/v3/users/df51193f4ede4e77a3f00ac4e0205892 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:21.855350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7e962-1a2c-418e-a72b-cd0a25a69d51 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:21.872340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7e962-1a2c-418e-a72b-cd0a25a69d51 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:21.877434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f77e5-9dee-45a8-b0b8-8c6ae4efdad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:21.878428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f77e5-9dee-45a8-b0b8-8c6ae4efdad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:21.878711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f77e5-9dee-45a8-b0b8-8c6ae4efdad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:21.878989 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f77e5-9dee-45a8-b0b8-8c6ae4efdad6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:21.880296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f77e5-9dee-45a8-b0b8-8c6ae4efdad6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:21.882726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f77e5-9dee-45a8-b0b8-8c6ae4efdad6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:21.884495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 13/26] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:21.893090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdd693-d54c-4a5e-aec5-36aa07fb5290 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:21.908342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdd693-d54c-4a5e-aec5-36aa07fb5290 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:21.917497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbe93a-bfd3-46d3-aed1-dcad911618b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:21.918425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbe93a-bfd3-46d3-aed1-dcad911618b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:21.918712 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbe93a-bfd3-46d3-aed1-dcad911618b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:21.918991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbe93a-bfd3-46d3-aed1-dcad911618b8 admin admin] PATH_INFO: `/v3/domains/default/users/df51193f4ede4e77a3f00ac4e0205892/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:21.921086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbe93a-bfd3-46d3-aed1-dcad911618b8 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=df51193f4ede4e77a3f00ac4e0205892, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:21.922308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-96fbe93a-bfd3-46d3-aed1-dcad911618b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:21.922308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:23:21.922308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:23:21.924746 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ce4f0-d6e0-4226-b7f6-7ba49c261f73 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:21.925054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ce4f0-d6e0-4226-b7f6-7ba49c261f73 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:21.925292 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ce4f0-d6e0-4226-b7f6-7ba49c261f73 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:21.927310 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 14/27] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:23:21.928817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbe93a-bfd3-46d3-aed1-dcad911618b8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:21.934330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262762db-3769-48a3-a0ce-fb7fe8a4b1dd None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:21.934617 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262762db-3769-48a3-a0ce-fb7fe8a4b1dd None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:21.934858 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262762db-3769-48a3-a0ce-fb7fe8a4b1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:21.971502 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-262762db-3769-48a3-a0ce-fb7fe8a4b1dd None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:21.972715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-262762db-3769-48a3-a0ce-fb7fe8a4b1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:22.142680 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 15/28] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:22.144023 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217038c4-8099-4554-873f-c3b164d42f4c None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:22.144311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217038c4-8099-4554-873f-c3b164d42f4c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:22.144593 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217038c4-8099-4554-873f-c3b164d42f4c None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:22.146574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 16/29] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:22.154306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a317a-0594-4c63-94a9-c3810339704b None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:22.154596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a317a-0594-4c63-94a9-c3810339704b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:22.154883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a317a-0594-4c63-94a9-c3810339704b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:22.190133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-317a317a-0594-4c63-94a9-c3810339704b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:22.191361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-317a317a-0594-4c63-94a9-c3810339704b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:22.211182 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 17/30] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:22.214659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a317a-0594-4c63-94a9-c3810339704b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:22.233434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a317a-0594-4c63-94a9-c3810339704b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:22.247477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d8502-662a-418f-a4c5-ed74db2ce294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:22.248233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d8502-662a-418f-a4c5-ed74db2ce294 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:22.248515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d8502-662a-418f-a4c5-ed74db2ce294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:22.248835 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d8502-662a-418f-a4c5-ed74db2ce294 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:22.249620 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d8502-662a-418f-a4c5-ed74db2ce294 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:22.250675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-261d8502-662a-418f-a4c5-ed74db2ce294 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:22.250675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:23:22.250675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:23:22.251600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d8502-662a-418f-a4c5-ed74db2ce294 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:22.252908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 14/31] 10.222.0.83 () {58 vars in 1382 bytes} [Wed Dec 15 13:23:21 2021] PUT /identity/v3/domains/default/users/df51193f4ede4e77a3f00ac4e0205892/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:23:22.277385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbe93a-bfd3-46d3-aed1-dcad911618b8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:22.296326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbe93a-bfd3-46d3-aed1-dcad911618b8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:22.306484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4621d83-271e-4b44-a409-5c467412bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:22.307204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4621d83-271e-4b44-a409-5c467412bac6 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:22.307748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4621d83-271e-4b44-a409-5c467412bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:22.308019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4621d83-271e-4b44-a409-5c467412bac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:22.308828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4621d83-271e-4b44-a409-5c467412bac6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:22.318528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-a4621d83-271e-4b44-a409-5c467412bac6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:22.318528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:23:22.318528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:23:22.319547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4621d83-271e-4b44-a409-5c467412bac6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:22.362484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 15/32] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:23:22 2021] POST /identity/v3/roles => generated 219 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:23:22.458755 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d19b3-b6ed-460d-8f41-f7fe89fc5dd1 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:22.459375 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d19b3-b6ed-460d-8f41-f7fe89fc5dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:22.459860 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d19b3-b6ed-460d-8f41-f7fe89fc5dd1 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:22.462331 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 16/33] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:22.469282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90213e1-4ae6-46b8-b136-e40b6e8ad146 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:22.469989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90213e1-4ae6-46b8-b136-e40b6e8ad146 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:22.470472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90213e1-4ae6-46b8-b136-e40b6e8ad146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:22.514599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f90213e1-4ae6-46b8-b136-e40b6e8ad146 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:22.516648 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f90213e1-4ae6-46b8-b136-e40b6e8ad146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:22.542163 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 17/34] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:22.592813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90213e1-4ae6-46b8-b136-e40b6e8ad146 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:22.596407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 18/35] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:23:22 2021] POST /identity/v3/roles => generated 225 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:23:22.607529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90213e1-4ae6-46b8-b136-e40b6e8ad146 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:22.624233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbd8b1-1077-4d67-a6df-205321a56684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:22.634752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd8b1-1077-4d67-a6df-205321a56684 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:22.635156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd8b1-1077-4d67-a6df-205321a56684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:22.635453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd8b1-1077-4d67-a6df-205321a56684 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:22.652947 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbd8b1-1077-4d67-a6df-205321a56684 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:22.656318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbd8b1-1077-4d67-a6df-205321a56684 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:22.699930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-89fbd8b1-1077-4d67-a6df-205321a56684 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:23:22.701497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 18/36] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:22.712345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d8502-662a-418f-a4c5-ed74db2ce294 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:22.733401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d8502-662a-418f-a4c5-ed74db2ce294 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:22.748020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ff028-7325-4a78-b7f2-d6b549867bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:22.749370 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ff028-7325-4a78-b7f2-d6b549867bdf admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:22.749953 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ff028-7325-4a78-b7f2-d6b549867bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:22.750449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ff028-7325-4a78-b7f2-d6b549867bdf admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:22.751465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ff028-7325-4a78-b7f2-d6b549867bdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:22.752299 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ff028-7325-4a78-b7f2-d6b549867bdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:22.754373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-9e2ff028-7325-4a78-b7f2-d6b549867bdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:22.754373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:23:22.754373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:23:22.756087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ff028-7325-4a78-b7f2-d6b549867bdf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:22.778184 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 19/37] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:23:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:22.784714 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbd8b1-1077-4d67-a6df-205321a56684 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:22.801190 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbd8b1-1077-4d67-a6df-205321a56684 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:22.816176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63c9ad-775d-4822-bcc6-5fd4edd0eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:22.817377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63c9ad-775d-4822-bcc6-5fd4edd0eab8 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:22.817914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63c9ad-775d-4822-bcc6-5fd4edd0eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:22.818477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63c9ad-775d-4822-bcc6-5fd4edd0eab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:22.819742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63c9ad-775d-4822-bcc6-5fd4edd0eab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:22.820964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-dd63c9ad-775d-4822-bcc6-5fd4edd0eab8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:22.820964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:23:22.820964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:23:22.822468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63c9ad-775d-4822-bcc6-5fd4edd0eab8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:22.871441 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 19/38] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:23:22 2021] POST /identity/v3/projects => generated 301 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:23:23.457844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d1d9a-88b6-4076-8869-3e3119ffcb79 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:23.458222 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d1d9a-88b6-4076-8869-3e3119ffcb79 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:23.458444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d1d9a-88b6-4076-8869-3e3119ffcb79 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:23.460384 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 20/39] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:23.466102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fd508-87d7-4ea2-9c82-d43fb5affc4b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:23.466401 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fd508-87d7-4ea2-9c82-d43fb5affc4b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:23.466687 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fd508-87d7-4ea2-9c82-d43fb5affc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:23.485377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-2f4fd508-87d7-4ea2-9c82-d43fb5affc4b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:23.486617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2f4fd508-87d7-4ea2-9c82-d43fb5affc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:23.560857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 20/40] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:23.585788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d1d9a-88b6-4076-8869-3e3119ffcb79 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:23.601313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d1d9a-88b6-4076-8869-3e3119ffcb79 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:23.606573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cc0f9-8543-46fa-b30f-c16e14930b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:23.607406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc0f9-8543-46fa-b30f-c16e14930b01 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:23.607650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc0f9-8543-46fa-b30f-c16e14930b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:23.607939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc0f9-8543-46fa-b30f-c16e14930b01 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:23.609226 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cc0f9-8543-46fa-b30f-c16e14930b01 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:23.611006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cc0f9-8543-46fa-b30f-c16e14930b01 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:23.612610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 21/41] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:23.619611 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fd508-87d7-4ea2-9c82-d43fb5affc4b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:23.630819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fd508-87d7-4ea2-9c82-d43fb5affc4b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:23.637863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b15853-a691-41d8-8178-0fb4a740f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:23.639057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15853-a691-41d8-8178-0fb4a740f2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:23.639599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15853-a691-41d8-8178-0fb4a740f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:23.640081 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15853-a691-41d8-8178-0fb4a740f2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:23.641022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b15853-a691-41d8-8178-0fb4a740f2a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:23.643371 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b15853-a691-41d8-8178-0fb4a740f2a3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:23.673787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 21/42] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:23:23 2021] POST /identity/v3/projects => generated 312 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:23:23.676727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb933096-5e0c-4ebb-b693-76a41e464de5 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:23.677135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb933096-5e0c-4ebb-b693-76a41e464de5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:23.677901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb933096-5e0c-4ebb-b693-76a41e464de5 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:23.681048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 22/43] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:23 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:23.690744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cdc02-8945-46f5-a898-5e74e4f7bc92 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:23.691485 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cdc02-8945-46f5-a898-5e74e4f7bc92 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:23.691982 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cdc02-8945-46f5-a898-5e74e4f7bc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:23.721125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-3b1cdc02-8945-46f5-a898-5e74e4f7bc92 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:23.723287 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3b1cdc02-8945-46f5-a898-5e74e4f7bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:23.801988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 22/44] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:23.833496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb933096-5e0c-4ebb-b693-76a41e464de5 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:23.850385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb933096-5e0c-4ebb-b693-76a41e464de5 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:23.856589 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3542334-0964-47b6-b89c-0ce835bc62fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:23.857509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542334-0964-47b6-b89c-0ce835bc62fa admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:23.858222 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542334-0964-47b6-b89c-0ce835bc62fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:23.858623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542334-0964-47b6-b89c-0ce835bc62fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:23.859715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3542334-0964-47b6-b89c-0ce835bc62fa admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:23.862699 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3542334-0964-47b6-b89c-0ce835bc62fa admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:23.886012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 23/45] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:23:23 2021] POST /identity/v3/roles => generated 223 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:23:25.192920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea114a-9d4e-4235-bb08-d94d08eaa0c8 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:25.193490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea114a-9d4e-4235-bb08-d94d08eaa0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:25.193490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea114a-9d4e-4235-bb08-d94d08eaa0c8 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:25.195391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 23/46] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:23:25.201401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaf38b-6eee-4f4d-b166-3b003ce265ef None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:25.201878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaf38b-6eee-4f4d-b166-3b003ce265ef None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:25.202003 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaf38b-6eee-4f4d-b166-3b003ce265ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:25.220539 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-bcaaf38b-6eee-4f4d-b166-3b003ce265ef None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:25.222138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bcaaf38b-6eee-4f4d-b166-3b003ce265ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:25.230528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 24/47] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:25.254957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea114a-9d4e-4235-bb08-d94d08eaa0c8 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:25.267409 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea114a-9d4e-4235-bb08-d94d08eaa0c8 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:25.271750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb901cfc-59c9-4a54-a776-e7081a55e2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:25.272544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb901cfc-59c9-4a54-a776-e7081a55e2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:25.272826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb901cfc-59c9-4a54-a776-e7081a55e2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:25.273098 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb901cfc-59c9-4a54-a776-e7081a55e2e3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:25.283803 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb901cfc-59c9-4a54-a776-e7081a55e2e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:25.291215 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-cb901cfc-59c9-4a54-a776-e7081a55e2e3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:23:25.292589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 24/48] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:23:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:23:25.298682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaf38b-6eee-4f4d-b166-3b003ce265ef None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:25.309019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaf38b-6eee-4f4d-b166-3b003ce265ef None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:25.313705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b1c7c-8bb7-48e8-9e00-639c23302de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:25.314451 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b1c7c-8bb7-48e8-9e00-639c23302de2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:25.314738 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b1c7c-8bb7-48e8-9e00-639c23302de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:25.315013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b1c7c-8bb7-48e8-9e00-639c23302de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:25.315850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b1c7c-8bb7-48e8-9e00-639c23302de2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:25.316154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b1c7c-8bb7-48e8-9e00-639c23302de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:25.317851 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b1c7c-8bb7-48e8-9e00-639c23302de2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:25.326773 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 25/49] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:25.333033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb901cfc-59c9-4a54-a776-e7081a55e2e3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:25.343806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb901cfc-59c9-4a54-a776-e7081a55e2e3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:25.348395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855bcf-827c-49ba-998a-95f356df0b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:25.349271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855bcf-827c-49ba-998a-95f356df0b3f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:25.349557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855bcf-827c-49ba-998a-95f356df0b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:25.349927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855bcf-827c-49ba-998a-95f356df0b3f admin admin] PATH_INFO: `/v3/users/df51193f4ede4e77a3f00ac4e0205892` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:25.351680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855bcf-827c-49ba-998a-95f356df0b3f admin admin] RBAC: Authorizing `identity:get_user(user_id=df51193f4ede4e77a3f00ac4e0205892)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:25.353529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855bcf-827c-49ba-998a-95f356df0b3f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:25.355186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 25/50] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:25 2021] GET /identity/v3/users/df51193f4ede4e77a3f00ac4e0205892 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:25.361332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b1c7c-8bb7-48e8-9e00-639c23302de2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:25.371628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b1c7c-8bb7-48e8-9e00-639c23302de2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:25.375981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bccc2-20ec-49c7-8d93-0374b97c73e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:25.376776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bccc2-20ec-49c7-8d93-0374b97c73e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:25.377057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bccc2-20ec-49c7-8d93-0374b97c73e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:25.377333 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bccc2-20ec-49c7-8d93-0374b97c73e5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:25.378958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bccc2-20ec-49c7-8d93-0374b97c73e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:25.380641 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bccc2-20ec-49c7-8d93-0374b97c73e5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:25.382311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 26/51] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:25.388502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855bcf-827c-49ba-998a-95f356df0b3f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:25.399033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855bcf-827c-49ba-998a-95f356df0b3f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:25.403508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0435c8-967b-4e70-ab5c-ed986014e255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:25.404152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0435c8-967b-4e70-ab5c-ed986014e255 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:25.404438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0435c8-967b-4e70-ab5c-ed986014e255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:25.404715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0435c8-967b-4e70-ab5c-ed986014e255 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:25.405556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0435c8-967b-4e70-ab5c-ed986014e255 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.domain.id=default, user.id=df51193f4ede4e77a3f00ac4e0205892) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:25.405898 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0435c8-967b-4e70-ab5c-ed986014e255 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:25.406928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-bd0435c8-967b-4e70-ab5c-ed986014e255 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:25.406928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:23:25.406928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:23:25.408099 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0435c8-967b-4e70-ab5c-ed986014e255 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:25.421641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 26/52] 10.222.0.83 () {56 vars in 1343 bytes} [Wed Dec 15 13:23:25 2021] GET /identity/v3/role_assignments?user.id=df51193f4ede4e77a3f00ac4e0205892&scope.domain.id=default&role.id=a312b345efeb490eb4234d1ace386dec => generated 530 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:26.121557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052ab19-abd2-431d-ac64-5c170bdf28aa None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:26.121933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052ab19-abd2-431d-ac64-5c170bdf28aa None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:26.122274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052ab19-abd2-431d-ac64-5c170bdf28aa None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:26.125313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 27/53] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:26.130157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9523463-3fcc-42c9-bc4a-c3c3ce63c1b8 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:26.130439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9523463-3fcc-42c9-bc4a-c3c3ce63c1b8 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:26.130715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9523463-3fcc-42c9-bc4a-c3c3ce63c1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:26.149538 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d9523463-3fcc-42c9-bc4a-c3c3ce63c1b8 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:26.150811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d9523463-3fcc-42c9-bc4a-c3c3ce63c1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:26.158376 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 27/54] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:26.182125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052ab19-abd2-431d-ac64-5c170bdf28aa None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:26.195184 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052ab19-abd2-431d-ac64-5c170bdf28aa None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:26.199432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cb539-fb9e-4de0-a7a0-0b4442924ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:26.200225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cb539-fb9e-4de0-a7a0-0b4442924ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:26.200514 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cb539-fb9e-4de0-a7a0-0b4442924ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:26.200795 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cb539-fb9e-4de0-a7a0-0b4442924ce1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:26.202026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cb539-fb9e-4de0-a7a0-0b4442924ce1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:26.203728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cb539-fb9e-4de0-a7a0-0b4442924ce1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:26.205346 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 28/55] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:26.212019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9523463-3fcc-42c9-bc4a-c3c3ce63c1b8 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:26.224541 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9523463-3fcc-42c9-bc4a-c3c3ce63c1b8 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:26.229046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91a9c0-3e71-409b-b768-ecd036258cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:26.229718 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91a9c0-3e71-409b-b768-ecd036258cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:26.230037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91a9c0-3e71-409b-b768-ecd036258cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:26.230315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91a9c0-3e71-409b-b768-ecd036258cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:26.231051 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91a9c0-3e71-409b-b768-ecd036258cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:26.233027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91a9c0-3e71-409b-b768-ecd036258cb9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:26.260592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 28/56] 10.222.0.83 () {60 vars in 1161 bytes} [Wed Dec 15 13:23:26 2021] POST /identity/v3/projects => generated 298 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:23:28.625102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4479a83-7b94-455f-b9de-33ae09629e0e None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:28.625676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4479a83-7b94-455f-b9de-33ae09629e0e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:28.625676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4479a83-7b94-455f-b9de-33ae09629e0e None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:28.627484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 29/57] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:28.635276 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532e020-70aa-43c9-9cd2-77a481913a60 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:28.635723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532e020-70aa-43c9-9cd2-77a481913a60 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:28.635852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532e020-70aa-43c9-9cd2-77a481913a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:28.654102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-9532e020-70aa-43c9-9cd2-77a481913a60 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:28.655143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9532e020-70aa-43c9-9cd2-77a481913a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:28.714095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 29/58] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:28.740211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4479a83-7b94-455f-b9de-33ae09629e0e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:28.752179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4479a83-7b94-455f-b9de-33ae09629e0e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:28.756862 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7c328-49ec-4e9d-840b-de9b1471989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:28.757676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7c328-49ec-4e9d-840b-de9b1471989a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:28.758022 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7c328-49ec-4e9d-840b-de9b1471989a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:28.758299 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7c328-49ec-4e9d-840b-de9b1471989a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:28.759488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7c328-49ec-4e9d-840b-de9b1471989a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:28.761166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7c328-49ec-4e9d-840b-de9b1471989a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:28.762788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 30/59] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:28.768594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532e020-70aa-43c9-9cd2-77a481913a60 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:28.778047 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532e020-70aa-43c9-9cd2-77a481913a60 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:28.782613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a674ce-63be-4c5b-8f6b-abc7a2d2c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:28.783280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a674ce-63be-4c5b-8f6b-abc7a2d2c1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:28.783570 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a674ce-63be-4c5b-8f6b-abc7a2d2c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:28.783853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a674ce-63be-4c5b-8f6b-abc7a2d2c1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:28.784596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a674ce-63be-4c5b-8f6b-abc7a2d2c1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:28.785613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-89a674ce-63be-4c5b-8f6b-abc7a2d2c1d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:28.785613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:23:28.785613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:23:28.786917 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a674ce-63be-4c5b-8f6b-abc7a2d2c1d5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:28.812515 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 30/60] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:23:28 2021] POST /identity/v3/users => generated 275 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:23:32.828297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318cc25-a610-41d1-8406-8aece3bc136a None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:32.829198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318cc25-a610-41d1-8406-8aece3bc136a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:32.829630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318cc25-a610-41d1-8406-8aece3bc136a None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:32.831739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 31/61] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:32.838147 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e8d88-7de5-469e-b00c-a0a65a4e92bd None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:32.838997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e8d88-7de5-469e-b00c-a0a65a4e92bd None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:32.839465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e8d88-7de5-469e-b00c-a0a65a4e92bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:32.867398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e73e8d88-7de5-469e-b00c-a0a65a4e92bd None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:32.868885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e73e8d88-7de5-469e-b00c-a0a65a4e92bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:32.877357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 31/62] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:32.900839 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318cc25-a610-41d1-8406-8aece3bc136a None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:32.919870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318cc25-a610-41d1-8406-8aece3bc136a None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:32.927239 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ccf59-0350-4b4e-8e01-fa2670a0fee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:32.928247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ccf59-0350-4b4e-8e01-fa2670a0fee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:32.928736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ccf59-0350-4b4e-8e01-fa2670a0fee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:32.929651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ccf59-0350-4b4e-8e01-fa2670a0fee5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:32.945450 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ccf59-0350-4b4e-8e01-fa2670a0fee5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:32.953344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-dc9ccf59-0350-4b4e-8e01-fa2670a0fee5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:23:32.954899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 32/63] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:23:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:32.961284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e8d88-7de5-469e-b00c-a0a65a4e92bd None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:32.961899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d06e-226c-49ab-832f-d2daa3318f3a None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:32.962191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d06e-226c-49ab-832f-d2daa3318f3a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:32.962473 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d06e-226c-49ab-832f-d2daa3318f3a None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:32.964304 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 33/64] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:32.975455 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5b3da-db0c-41d6-a661-b7d3e8147e84 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:32.978521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e8d88-7de5-469e-b00c-a0a65a4e92bd None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:32.979710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5b3da-db0c-41d6-a661-b7d3e8147e84 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:32.980593 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5b3da-db0c-41d6-a661-b7d3e8147e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:32.988735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a557c-e25d-4e12-9c66-4f528e226fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:32.989674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a557c-e25d-4e12-9c66-4f528e226fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:32.990179 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a557c-e25d-4e12-9c66-4f528e226fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:32.990689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a557c-e25d-4e12-9c66-4f528e226fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:32.993370 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a557c-e25d-4e12-9c66-4f528e226fd5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:32.993683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a557c-e25d-4e12-9c66-4f528e226fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:32.995533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a557c-e25d-4e12-9c66-4f528e226fd5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.004569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 32/65] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:23:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.006484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944be84-8049-4332-8305-2229a9955911 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.007040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944be84-8049-4332-8305-2229a9955911 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.007539 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944be84-8049-4332-8305-2229a9955911 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.009561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 33/66] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:33.010377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-7dc5b3da-db0c-41d6-a661-b7d3e8147e84 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:33.011664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7dc5b3da-db0c-41d6-a661-b7d3e8147e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:33.013446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944be84-8049-4332-8305-2229a9955911 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.022115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 34/67] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:33.026472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5a440-4f3b-46c1-bfc7-45c3fb841318 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.026472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5a440-4f3b-46c1-bfc7-45c3fb841318 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.026472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5a440-4f3b-46c1-bfc7-45c3fb841318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.039284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944be84-8049-4332-8305-2229a9955911 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.051288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75db39-0ee9-4e0a-b062-94e7ff9ba4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.052181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75db39-0ee9-4e0a-b062-94e7ff9ba4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.052463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75db39-0ee9-4e0a-b062-94e7ff9ba4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.052739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75db39-0ee9-4e0a-b062-94e7ff9ba4e3 admin admin] PATH_INFO: `/v3/users/7f6ea9c48af34ff08a498c9f779db002` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.059298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-f2f5a440-4f3b-46c1-bfc7-45c3fb841318 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:33.060497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f2f5a440-4f3b-46c1-bfc7-45c3fb841318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:33.068731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75db39-0ee9-4e0a-b062-94e7ff9ba4e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=7f6ea9c48af34ff08a498c9f779db002)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.069032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 35/68] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:33.069836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5a440-4f3b-46c1-bfc7-45c3fb841318 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.071831 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75db39-0ee9-4e0a-b062-94e7ff9ba4e3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.073777 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 34/69] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/users/7f6ea9c48af34ff08a498c9f779db002 => generated 275 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:33.083001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75db39-0ee9-4e0a-b062-94e7ff9ba4e3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.093911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5a440-4f3b-46c1-bfc7-45c3fb841318 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.098531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75db39-0ee9-4e0a-b062-94e7ff9ba4e3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.102598 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e718171-ac9e-4bf9-b69f-f16937b4d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.103537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e718171-ac9e-4bf9-b69f-f16937b4d915 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.103885 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e718171-ac9e-4bf9-b69f-f16937b4d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.104170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e718171-ac9e-4bf9-b69f-f16937b4d915 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.104697 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c3d0-2349-45ba-a2f3-f202a0b2e9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.105547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c3d0-2349-45ba-a2f3-f202a0b2e9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.106055 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c3d0-2349-45ba-a2f3-f202a0b2e9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.106528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c3d0-2349-45ba-a2f3-f202a0b2e9f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.115088 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c3d0-2349-45ba-a2f3-f202a0b2e9f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.116109 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e718171-ac9e-4bf9-b69f-f16937b4d915 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:33.117396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c3d0-2349-45ba-a2f3-f202a0b2e9f4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.123726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-9e718171-ac9e-4bf9-b69f-f16937b4d915 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:23:33.129711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 36/70] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:33.129711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e718171-ac9e-4bf9-b69f-f16937b4d915 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.132326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 35/71] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:33.135069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c3d0-2349-45ba-a2f3-f202a0b2e9f4 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.137648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e718171-ac9e-4bf9-b69f-f16937b4d915 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.142977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883906b-4407-4b97-a25b-9a551dd38b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.144033 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883906b-4407-4b97-a25b-9a551dd38b07 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.144321 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883906b-4407-4b97-a25b-9a551dd38b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.144602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883906b-4407-4b97-a25b-9a551dd38b07 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.146189 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c3d0-2349-45ba-a2f3-f202a0b2e9f4 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.151459 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b93351-0455-4763-b79f-1eba1c87232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.152348 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b93351-0455-4763-b79f-1eba1c87232c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.152854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b93351-0455-4763-b79f-1eba1c87232c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.153334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b93351-0455-4763-b79f-1eba1c87232c admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.154343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b93351-0455-4763-b79f-1eba1c87232c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:33.154992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b93351-0455-4763-b79f-1eba1c87232c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.156509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883906b-4407-4b97-a25b-9a551dd38b07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:33.157088 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b93351-0455-4763-b79f-1eba1c87232c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.169604 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-4883906b-4407-4b97-a25b-9a551dd38b07 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:23:33.173892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 37/72] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:33.175013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883906b-4407-4b97-a25b-9a551dd38b07 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.180504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 36/73] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:33.181680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b93351-0455-4763-b79f-1eba1c87232c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.187699 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883906b-4407-4b97-a25b-9a551dd38b07 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.192289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b93351-0455-4763-b79f-1eba1c87232c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.192925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dbd63-c023-4320-ad90-0340a4d4063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.193920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dbd63-c023-4320-ad90-0340a4d4063e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.194208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dbd63-c023-4320-ad90-0340a4d4063e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.194520 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dbd63-c023-4320-ad90-0340a4d4063e admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.196139 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dbd63-c023-4320-ad90-0340a4d4063e admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.198423 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74dbc1-71cc-406e-b907-ccdadef4cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.198694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dbd63-c023-4320-ad90-0340a4d4063e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.199523 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74dbc1-71cc-406e-b907-ccdadef4cea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.200068 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74dbc1-71cc-406e-b907-ccdadef4cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.200586 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74dbc1-71cc-406e-b907-ccdadef4cea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.200695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 38/74] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.201387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dbd63-c023-4320-ad90-0340a4d4063e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.202034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74dbc1-71cc-406e-b907-ccdadef4cea7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:33.202551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74dbc1-71cc-406e-b907-ccdadef4cea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.204375 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74dbc1-71cc-406e-b907-ccdadef4cea7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.213151 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dbd63-c023-4320-ad90-0340a4d4063e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.214449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 37/75] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.215566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74dbc1-71cc-406e-b907-ccdadef4cea7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.229103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988869d7-6cd0-42db-96a2-145ccf9a8541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.230116 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988869d7-6cd0-42db-96a2-145ccf9a8541 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.230854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988869d7-6cd0-42db-96a2-145ccf9a8541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.231329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988869d7-6cd0-42db-96a2-145ccf9a8541 admin admin] PATH_INFO: `/v3/users/7f6ea9c48af34ff08a498c9f779db002` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.232807 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74dbc1-71cc-406e-b907-ccdadef4cea7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.233286 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988869d7-6cd0-42db-96a2-145ccf9a8541 admin admin] RBAC: Authorizing `identity:get_user(user_id=7f6ea9c48af34ff08a498c9f779db002)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.236071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988869d7-6cd0-42db-96a2-145ccf9a8541 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.238243 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 39/76] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/users/7f6ea9c48af34ff08a498c9f779db002 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.238606 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdfa6d-8c4c-42ec-bb92-bf80cc353bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.239141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988869d7-6cd0-42db-96a2-145ccf9a8541 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.239739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfa6d-8c4c-42ec-bb92-bf80cc353bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.240210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfa6d-8c4c-42ec-bb92-bf80cc353bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.240739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfa6d-8c4c-42ec-bb92-bf80cc353bb6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.241872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdfa6d-8c4c-42ec-bb92-bf80cc353bb6 admin admin] RBAC: Adding query filter params (role.id=78ec5da190bd41768cafe7cade4d3d69, scope.project.id=eb37d41816d74f66a5087e325e84211f, user.id=7f6ea9c48af34ff08a498c9f779db002) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:33.242415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdfa6d-8c4c-42ec-bb92-bf80cc353bb6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.244640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdfa6d-8c4c-42ec-bb92-bf80cc353bb6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.252594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 38/77] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/role_assignments?user.id=7f6ea9c48af34ff08a498c9f779db002&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=78ec5da190bd41768cafe7cade4d3d69 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.256110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988869d7-6cd0-42db-96a2-145ccf9a8541 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.256262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdfa6d-8c4c-42ec-bb92-bf80cc353bb6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.266196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdfa6d-8c4c-42ec-bb92-bf80cc353bb6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.270964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c62752-5c50-46b6-97a0-f1f7a64d8d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.273242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c62752-5c50-46b6-97a0-f1f7a64d8d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.274158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c62752-5c50-46b6-97a0-f1f7a64d8d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.275221 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c62752-5c50-46b6-97a0-f1f7a64d8d51 admin admin] PATH_INFO: `/v3/users/df51193f4ede4e77a3f00ac4e0205892` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.276045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d26bc-9aca-44f3-92e8-59ac297a5031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.276989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d26bc-9aca-44f3-92e8-59ac297a5031 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.277483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d26bc-9aca-44f3-92e8-59ac297a5031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.278752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d26bc-9aca-44f3-92e8-59ac297a5031 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.280389 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c62752-5c50-46b6-97a0-f1f7a64d8d51 admin admin] RBAC: Authorizing `identity:get_user(user_id=df51193f4ede4e77a3f00ac4e0205892)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.283297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c62752-5c50-46b6-97a0-f1f7a64d8d51 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.290467 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 40/78] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/users/df51193f4ede4e77a3f00ac4e0205892 => generated 247 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.292258 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079149d5-ba4e-49e4-92f8-189b8491e8f7 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.292781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079149d5-ba4e-49e4-92f8-189b8491e8f7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.293272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079149d5-ba4e-49e4-92f8-189b8491e8f7 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.293901 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d26bc-9aca-44f3-92e8-59ac297a5031 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.295628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 41/79] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:33.299226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d26bc-9aca-44f3-92e8-59ac297a5031 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.304764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d882-889b-4f23-a371-7771d14a16c9 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.305448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d882-889b-4f23-a371-7771d14a16c9 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.305955 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d882-889b-4f23-a371-7771d14a16c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.311280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 39/80] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:33.312462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d26bc-9aca-44f3-92e8-59ac297a5031 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.327193 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d26bc-9aca-44f3-92e8-59ac297a5031 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.331919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8861d882-889b-4f23-a371-7771d14a16c9 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:33.332624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c676be4-32d7-40bc-b2a7-774c5f0ae85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.333394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c676be4-32d7-40bc-b2a7-774c5f0ae85d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.333795 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8861d882-889b-4f23-a371-7771d14a16c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:33.333920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c676be4-32d7-40bc-b2a7-774c5f0ae85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.334254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c676be4-32d7-40bc-b2a7-774c5f0ae85d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.343849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c676be4-32d7-40bc-b2a7-774c5f0ae85d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.345897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c676be4-32d7-40bc-b2a7-774c5f0ae85d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.349909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 42/81] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:33.351739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d882-889b-4f23-a371-7771d14a16c9 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.362602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 40/82] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:33.368480 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d882-889b-4f23-a371-7771d14a16c9 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.377789 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c676be4-32d7-40bc-b2a7-774c5f0ae85d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.377999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e60bde-74dd-4651-b33c-133479562c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.377999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e60bde-74dd-4651-b33c-133479562c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.377999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e60bde-74dd-4651-b33c-133479562c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.377999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e60bde-74dd-4651-b33c-133479562c91 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.378961 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e60bde-74dd-4651-b33c-133479562c91 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.381086 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e60bde-74dd-4651-b33c-133479562c91 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.384198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 43/83] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.385354 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e60bde-74dd-4651-b33c-133479562c91 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.385669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c676be4-32d7-40bc-b2a7-774c5f0ae85d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.396978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de345c-e906-44e4-9853-6dde776bd422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.398188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de345c-e906-44e4-9853-6dde776bd422 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.398635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de345c-e906-44e4-9853-6dde776bd422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.399072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de345c-e906-44e4-9853-6dde776bd422 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.399619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e60bde-74dd-4651-b33c-133479562c91 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.400788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de345c-e906-44e4-9853-6dde776bd422 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.403792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de345c-e906-44e4-9853-6dde776bd422 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.404430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc9772-7763-405b-b9ee-f476712515b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.405313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9772-7763-405b-b9ee-f476712515b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.405662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9772-7763-405b-b9ee-f476712515b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.406031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9772-7763-405b-b9ee-f476712515b5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.406508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 41/84] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.407525 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc9772-7763-405b-b9ee-f476712515b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.407894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de345c-e906-44e4-9853-6dde776bd422 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.411143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc9772-7763-405b-b9ee-f476712515b5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.411307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 44/85] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.415904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2a01-700c-41c5-8070-98e5b1481d2c None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.415904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2a01-700c-41c5-8070-98e5b1481d2c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.415904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2a01-700c-41c5-8070-98e5b1481d2c None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.415904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 45/86] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:33.417385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca2a01-700c-41c5-8070-98e5b1481d2c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.424076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de345c-e906-44e4-9853-6dde776bd422 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.429486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cd743-5617-4c22-ac13-5adb55d79e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.430500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd743-5617-4c22-ac13-5adb55d79e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.431001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd743-5617-4c22-ac13-5adb55d79e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.431487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd743-5617-4c22-ac13-5adb55d79e4d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.431698 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca2a01-700c-41c5-8070-98e5b1481d2c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.433296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cd743-5617-4c22-ac13-5adb55d79e4d admin admin] RBAC: Adding query filter params (role.id=78401ee743b448d48b6c94ff8642907e, scope.project.id=eb37d41816d74f66a5087e325e84211f, user.id=7f6ea9c48af34ff08a498c9f779db002) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:33.433716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cd743-5617-4c22-ac13-5adb55d79e4d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.435726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cd743-5617-4c22-ac13-5adb55d79e4d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.436614 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c02f43-c8c5-4fbf-a120-2a0bf614f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.437279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c02f43-c8c5-4fbf-a120-2a0bf614f268 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.437562 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c02f43-c8c5-4fbf-a120-2a0bf614f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.438050 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c02f43-c8c5-4fbf-a120-2a0bf614f268 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.438727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c02f43-c8c5-4fbf-a120-2a0bf614f268 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=eb37d41816d74f66a5087e325e84211f, user.id=df51193f4ede4e77a3f00ac4e0205892) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:33.439042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c02f43-c8c5-4fbf-a120-2a0bf614f268 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.440930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c02f43-c8c5-4fbf-a120-2a0bf614f268 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.442356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 42/87] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/role_assignments?user.id=7f6ea9c48af34ff08a498c9f779db002&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=78401ee743b448d48b6c94ff8642907e => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.443367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cd743-5617-4c22-ac13-5adb55d79e4d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.454738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cd743-5617-4c22-ac13-5adb55d79e4d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.461794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 46/88] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/role_assignments?user.id=df51193f4ede4e77a3f00ac4e0205892&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=a312b345efeb490eb4234d1ace386dec => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.461794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41405b-1190-499d-b03a-a7fc9a5811df None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.461794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41405b-1190-499d-b03a-a7fc9a5811df None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.461794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41405b-1190-499d-b03a-a7fc9a5811df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.480039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-4a41405b-1190-499d-b03a-a7fc9a5811df None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:33.481020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224aab8-8719-4a81-bcb7-39137dd88d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.481980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4a41405b-1190-499d-b03a-a7fc9a5811df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:33.482129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224aab8-8719-4a81-bcb7-39137dd88d2c admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.482621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224aab8-8719-4a81-bcb7-39137dd88d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.483079 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224aab8-8719-4a81-bcb7-39137dd88d2c admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.484059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224aab8-8719-4a81-bcb7-39137dd88d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.486550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224aab8-8719-4a81-bcb7-39137dd88d2c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.495751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 47/89] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:33.514390 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 43/90] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:23:33 2021] POST /identity/v3/users => generated 289 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:23:33.525317 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41405b-1190-499d-b03a-a7fc9a5811df None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.538664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41405b-1190-499d-b03a-a7fc9a5811df None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.544926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e3ad4-2aa0-4183-9868-e8a49f93fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.545848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e3ad4-2aa0-4183-9868-e8a49f93fb1d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.546140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e3ad4-2aa0-4183-9868-e8a49f93fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.546428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e3ad4-2aa0-4183-9868-e8a49f93fb1d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.561074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e3ad4-2aa0-4183-9868-e8a49f93fb1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:33.568542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-107e3ad4-2aa0-4183-9868-e8a49f93fb1d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:23:33.571062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 48/91] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:33.577775 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224aab8-8719-4a81-bcb7-39137dd88d2c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.589124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224aab8-8719-4a81-bcb7-39137dd88d2c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.594239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b6661-ef5a-405c-9ed4-78075f5f821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.594957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b6661-ef5a-405c-9ed4-78075f5f821b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.595247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b6661-ef5a-405c-9ed4-78075f5f821b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.595603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b6661-ef5a-405c-9ed4-78075f5f821b admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.596448 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b6661-ef5a-405c-9ed4-78075f5f821b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:33.596816 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b6661-ef5a-405c-9ed4-78075f5f821b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.598752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b6661-ef5a-405c-9ed4-78075f5f821b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.610169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 44/92] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.617863 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e3ad4-2aa0-4183-9868-e8a49f93fb1d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.629058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e3ad4-2aa0-4183-9868-e8a49f93fb1d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.634180 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c81471-e31e-44bc-ba55-f7d5c28e26b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.635195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c81471-e31e-44bc-ba55-f7d5c28e26b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.635484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c81471-e31e-44bc-ba55-f7d5c28e26b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.635822 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c81471-e31e-44bc-ba55-f7d5c28e26b4 admin admin] PATH_INFO: `/v3/users/7f6ea9c48af34ff08a498c9f779db002` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.637358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c81471-e31e-44bc-ba55-f7d5c28e26b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=7f6ea9c48af34ff08a498c9f779db002)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.639888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c81471-e31e-44bc-ba55-f7d5c28e26b4 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.641910 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 49/93] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/users/7f6ea9c48af34ff08a498c9f779db002 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.648680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b6661-ef5a-405c-9ed4-78075f5f821b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.661275 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b6661-ef5a-405c-9ed4-78075f5f821b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.667243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159508d-eaa5-4f2a-9f19-23cec16e9818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.669013 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159508d-eaa5-4f2a-9f19-23cec16e9818 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.669261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159508d-eaa5-4f2a-9f19-23cec16e9818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.669578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159508d-eaa5-4f2a-9f19-23cec16e9818 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.681854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159508d-eaa5-4f2a-9f19-23cec16e9818 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.684030 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159508d-eaa5-4f2a-9f19-23cec16e9818 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.696789 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 45/94] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:33.703303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c81471-e31e-44bc-ba55-f7d5c28e26b4 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.714717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c81471-e31e-44bc-ba55-f7d5c28e26b4 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.719872 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd100e-07f6-4952-98d4-ea6488d595af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.720704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd100e-07f6-4952-98d4-ea6488d595af admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.720991 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd100e-07f6-4952-98d4-ea6488d595af admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.721274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd100e-07f6-4952-98d4-ea6488d595af admin admin] PATH_INFO: `/v3/projects/46ee13423f67497f839dafbe20f3f739` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.722600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd100e-07f6-4952-98d4-ea6488d595af admin admin] RBAC: Authorizing `identity:get_project(project_id=46ee13423f67497f839dafbe20f3f739)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.724715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd100e-07f6-4952-98d4-ea6488d595af admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.727029 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 50/95] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/projects/46ee13423f67497f839dafbe20f3f739 => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:33.733722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159508d-eaa5-4f2a-9f19-23cec16e9818 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:33.744010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159508d-eaa5-4f2a-9f19-23cec16e9818 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:33.751336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ace74-b1b5-4f1c-b59d-1761c85be035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:33.752036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ace74-b1b5-4f1c-b59d-1761c85be035 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:33.752316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ace74-b1b5-4f1c-b59d-1761c85be035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:33.752601 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ace74-b1b5-4f1c-b59d-1761c85be035 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:33.753484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ace74-b1b5-4f1c-b59d-1761c85be035 admin admin] RBAC: Adding query filter params (role.id=78401ee743b448d48b6c94ff8642907e, scope.project.id=46ee13423f67497f839dafbe20f3f739, user.id=7f6ea9c48af34ff08a498c9f779db002) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:33.753838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ace74-b1b5-4f1c-b59d-1761c85be035 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:33.755856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ace74-b1b5-4f1c-b59d-1761c85be035 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:33.765501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 46/96] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:33 2021] GET /identity/v3/role_assignments?user.id=7f6ea9c48af34ff08a498c9f779db002&scope.project.id=46ee13423f67497f839dafbe20f3f739&role.id=78401ee743b448d48b6c94ff8642907e => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:36.407788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde193d8-6433-4889-ac0b-5f1474fa92d4 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.408788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde193d8-6433-4889-ac0b-5f1474fa92d4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.409280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde193d8-6433-4889-ac0b-5f1474fa92d4 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.411330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 51/97] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:36.417471 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f96b-dabe-4b1f-8dfa-7fede124467d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.418332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f96b-dabe-4b1f-8dfa-7fede124467d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.418827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f96b-dabe-4b1f-8dfa-7fede124467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.447508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-10b0f96b-dabe-4b1f-8dfa-7fede124467d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:36.449037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-10b0f96b-dabe-4b1f-8dfa-7fede124467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:36.461609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 47/98] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:36.509300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde193d8-6433-4889-ac0b-5f1474fa92d4 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:36.527342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde193d8-6433-4889-ac0b-5f1474fa92d4 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:36.532260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99650f5-c30e-4595-b50e-0df926b94538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:36.533300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99650f5-c30e-4595-b50e-0df926b94538 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.533827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99650f5-c30e-4595-b50e-0df926b94538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.534322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99650f5-c30e-4595-b50e-0df926b94538 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.547544 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99650f5-c30e-4595-b50e-0df926b94538 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:36.555159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-e99650f5-c30e-4595-b50e-0df926b94538 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:23:36.556577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 52/99] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:23:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:36.563124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0f96b-dabe-4b1f-8dfa-7fede124467d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:36.580286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0f96b-dabe-4b1f-8dfa-7fede124467d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:36.585966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2ce84-28ef-4731-a5bf-770b2ef519ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:36.586875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2ce84-28ef-4731-a5bf-770b2ef519ab admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.587398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2ce84-28ef-4731-a5bf-770b2ef519ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.587884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2ce84-28ef-4731-a5bf-770b2ef519ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.588863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2ce84-28ef-4731-a5bf-770b2ef519ab admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:36.589391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2ce84-28ef-4731-a5bf-770b2ef519ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:36.591268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2ce84-28ef-4731-a5bf-770b2ef519ab admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:36.598504 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482ba35-26f5-4d49-a770-28c80db9c94b None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.599103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482ba35-26f5-4d49-a770-28c80db9c94b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.599592 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482ba35-26f5-4d49-a770-28c80db9c94b None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.601637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 53/100] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:23:36.609651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 48/101] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:23:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:36.615504 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482ba35-26f5-4d49-a770-28c80db9c94b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:36.630157 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482ba35-26f5-4d49-a770-28c80db9c94b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:36.639623 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04f56-d4cb-4a57-8b00-9dd4fc766743 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.640134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04f56-d4cb-4a57-8b00-9dd4fc766743 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.640614 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04f56-d4cb-4a57-8b00-9dd4fc766743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.659932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23045706-47f0-4f22-b6e3-f2478c9a433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:36.660766 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23045706-47f0-4f22-b6e3-f2478c9a433c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.661054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23045706-47f0-4f22-b6e3-f2478c9a433c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.661331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23045706-47f0-4f22-b6e3-f2478c9a433c admin admin] PATH_INFO: `/v3/users/7f6ea9c48af34ff08a498c9f779db002` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.662633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23045706-47f0-4f22-b6e3-f2478c9a433c admin admin] RBAC: Authorizing `identity:get_user(user_id=7f6ea9c48af34ff08a498c9f779db002)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:36.664917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23045706-47f0-4f22-b6e3-f2478c9a433c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:36.671456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 54/102] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:36 2021] GET /identity/v3/users/7f6ea9c48af34ff08a498c9f779db002 => generated 275 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:36.672314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23045706-47f0-4f22-b6e3-f2478c9a433c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:36.683312 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-dbd04f56-d4cb-4a57-8b00-9dd4fc766743 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:36.684507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-dbd04f56-d4cb-4a57-8b00-9dd4fc766743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:36.690477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23045706-47f0-4f22-b6e3-f2478c9a433c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:36.700313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 49/103] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:36.701259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74092d8-b0f9-4e12-842e-bd2676165ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:36.702391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74092d8-b0f9-4e12-842e-bd2676165ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.702891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74092d8-b0f9-4e12-842e-bd2676165ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.703481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74092d8-b0f9-4e12-842e-bd2676165ee9 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.705607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf4eb-5d67-486b-abb6-9f06af65e608 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.706124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf4eb-5d67-486b-abb6-9f06af65e608 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.706610 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf4eb-5d67-486b-abb6-9f06af65e608 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.708566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 50/104] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:36.709926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74092d8-b0f9-4e12-842e-bd2676165ee9 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:36.712716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74092d8-b0f9-4e12-842e-bd2676165ee9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:36.714802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 55/105] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:36 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:36.716374 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c8bf4-fb46-40ad-95f9-b1ef15f67fc9 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.716865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c8bf4-fb46-40ad-95f9-b1ef15f67fc9 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.717367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c8bf4-fb46-40ad-95f9-b1ef15f67fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.727419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74092d8-b0f9-4e12-842e-bd2676165ee9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:36.748550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74092d8-b0f9-4e12-842e-bd2676165ee9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:36.755492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-981c8bf4-fb46-40ad-95f9-b1ef15f67fc9 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:36.758730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-981c8bf4-fb46-40ad-95f9-b1ef15f67fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:36.764920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93b28a-3a8c-41d3-9d4b-a0361e4cc75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:36.766115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93b28a-3a8c-41d3-9d4b-a0361e4cc75a admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.766607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93b28a-3a8c-41d3-9d4b-a0361e4cc75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.767083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93b28a-3a8c-41d3-9d4b-a0361e4cc75a admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f/users/7f6ea9c48af34ff08a498c9f779db002/roles/78ec5da190bd41768cafe7cade4d3d69` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.770896 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93b28a-3a8c-41d3-9d4b-a0361e4cc75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb37d41816d74f66a5087e325e84211f, user_id=7f6ea9c48af34ff08a498c9f779db002, role_id=78ec5da190bd41768cafe7cade4d3d69)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:36.772473 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-1a93b28a-3a8c-41d3-9d4b-a0361e4cc75a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:36.772473 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:23:36.772473 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:23:36.775772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93b28a-3a8c-41d3-9d4b-a0361e4cc75a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:36.784889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 51/106] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:36.786176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c8bf4-fb46-40ad-95f9-b1ef15f67fc9 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:36.812188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 56/107] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:23:36 2021] PUT /identity/v3/projects/eb37d41816d74f66a5087e325e84211f/users/7f6ea9c48af34ff08a498c9f779db002/roles/78ec5da190bd41768cafe7cade4d3d69 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:23:36.812655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c8bf4-fb46-40ad-95f9-b1ef15f67fc9 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:36.814941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93b28a-3a8c-41d3-9d4b-a0361e4cc75a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:36.902026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed391e-ccb2-4b2a-8e56-f1d75d7ee61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:36.903116 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed391e-ccb2-4b2a-8e56-f1d75d7ee61a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.903550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed391e-ccb2-4b2a-8e56-f1d75d7ee61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.903960 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed391e-ccb2-4b2a-8e56-f1d75d7ee61a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.924010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed391e-ccb2-4b2a-8e56-f1d75d7ee61a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:36.931711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-baed391e-ccb2-4b2a-8e56-f1d75d7ee61a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:23:36.933361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 52/108] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:23:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:36.941542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed391e-ccb2-4b2a-8e56-f1d75d7ee61a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:36.954605 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed391e-ccb2-4b2a-8e56-f1d75d7ee61a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:36.956208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93b28a-3a8c-41d3-9d4b-a0361e4cc75a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:36.959625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a07b28-d8c8-4e57-9779-cfd939fffdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:36.960573 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a07b28-d8c8-4e57-9779-cfd939fffdfb admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.961058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a07b28-d8c8-4e57-9779-cfd939fffdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.961540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a07b28-d8c8-4e57-9779-cfd939fffdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.966946 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a07b28-d8c8-4e57-9779-cfd939fffdfb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:36.967546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a07b28-d8c8-4e57-9779-cfd939fffdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:36.969430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a07b28-d8c8-4e57-9779-cfd939fffdfb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:36.978528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcfdd5-55c3-4c81-ac33-611f15859bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:36.979627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcfdd5-55c3-4c81-ac33-611f15859bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:36.980044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcfdd5-55c3-4c81-ac33-611f15859bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:36.980448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcfdd5-55c3-4c81-ac33-611f15859bb4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:36.985291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 53/109] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:36.996575 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a07b28-d8c8-4e57-9779-cfd939fffdfb admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.010439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcfdd5-55c3-4c81-ac33-611f15859bb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:37.011727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a07b28-d8c8-4e57-9779-cfd939fffdfb admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.016323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f4e48-a187-4ffb-b988-2822434725a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.017434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4e48-a187-4ffb-b988-2822434725a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.017535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-41bcfdd5-55c3-4c81-ac33-611f15859bb4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:23:37.021779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 57/110] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:37.022469 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4e48-a187-4ffb-b988-2822434725a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.022983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4e48-a187-4ffb-b988-2822434725a5 admin admin] PATH_INFO: `/v3/users/df51193f4ede4e77a3f00ac4e0205892` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.024613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f4e48-a187-4ffb-b988-2822434725a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=df51193f4ede4e77a3f00ac4e0205892)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.025270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcfdd5-55c3-4c81-ac33-611f15859bb4 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.026960 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f4e48-a187-4ffb-b988-2822434725a5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.028793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 54/111] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:36 2021] GET /identity/v3/users/df51193f4ede4e77a3f00ac4e0205892 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:37.035009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f4e48-a187-4ffb-b988-2822434725a5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.045014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f4e48-a187-4ffb-b988-2822434725a5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.054118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd4b47-1598-4e93-8c30-147c74d7cab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.054299 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcfdd5-55c3-4c81-ac33-611f15859bb4 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.055928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd4b47-1598-4e93-8c30-147c74d7cab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.056405 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd4b47-1598-4e93-8c30-147c74d7cab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.056893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd4b47-1598-4e93-8c30-147c74d7cab9 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.058870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd4b47-1598-4e93-8c30-147c74d7cab9 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.061225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd4b47-1598-4e93-8c30-147c74d7cab9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.066627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 55/112] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:37.067420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fad763-8707-4478-bbc7-5c1c4cfaec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.068017 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fad763-8707-4478-bbc7-5c1c4cfaec51 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.068313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fad763-8707-4478-bbc7-5c1c4cfaec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.068597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fad763-8707-4478-bbc7-5c1c4cfaec51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.070027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fad763-8707-4478-bbc7-5c1c4cfaec51 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:37.070345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fad763-8707-4478-bbc7-5c1c4cfaec51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.073445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd4b47-1598-4e93-8c30-147c74d7cab9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.073950 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fad763-8707-4478-bbc7-5c1c4cfaec51 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.092630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 58/113] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:37.093673 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fad763-8707-4478-bbc7-5c1c4cfaec51 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.096247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd4b47-1598-4e93-8c30-147c74d7cab9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.104390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fad763-8707-4478-bbc7-5c1c4cfaec51 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.115122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894edcd-f2bf-4203-a046-c4e9da0255c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.115604 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ce340-2c5e-4bb1-a120-b257a9efe6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.116045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894edcd-f2bf-4203-a046-c4e9da0255c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.116854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894edcd-f2bf-4203-a046-c4e9da0255c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.117130 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ce340-2c5e-4bb1-a120-b257a9efe6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.117222 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894edcd-f2bf-4203-a046-c4e9da0255c0 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f/users/df51193f4ede4e77a3f00ac4e0205892/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.117420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ce340-2c5e-4bb1-a120-b257a9efe6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.117700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ce340-2c5e-4bb1-a120-b257a9efe6b7 admin admin] PATH_INFO: `/v3/users/7f6ea9c48af34ff08a498c9f779db002` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.122814 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ce340-2c5e-4bb1-a120-b257a9efe6b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=7f6ea9c48af34ff08a498c9f779db002)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.125211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ce340-2c5e-4bb1-a120-b257a9efe6b7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.126713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894edcd-f2bf-4203-a046-c4e9da0255c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb37d41816d74f66a5087e325e84211f, user_id=df51193f4ede4e77a3f00ac4e0205892, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.127197 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 59/114] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/users/7f6ea9c48af34ff08a498c9f779db002 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:37.129466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894edcd-f2bf-4203-a046-c4e9da0255c0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.133981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ce340-2c5e-4bb1-a120-b257a9efe6b7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.156130 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ce340-2c5e-4bb1-a120-b257a9efe6b7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.172451 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 56/115] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:23:37 2021] PUT /identity/v3/projects/eb37d41816d74f66a5087e325e84211f/users/df51193f4ede4e77a3f00ac4e0205892/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:23:37.245523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ede976-5467-4fa3-941d-1d08058a5aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.246657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede976-5467-4fa3-941d-1d08058a5aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.246956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede976-5467-4fa3-941d-1d08058a5aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.247245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede976-5467-4fa3-941d-1d08058a5aa8 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.248530 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ede976-5467-4fa3-941d-1d08058a5aa8 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.250642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ede976-5467-4fa3-941d-1d08058a5aa8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.252781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 60/116] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:37.260052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894edcd-f2bf-4203-a046-c4e9da0255c0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.284571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894edcd-f2bf-4203-a046-c4e9da0255c0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.298621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91674e99-0ded-486d-bf21-09908cf50d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.299905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91674e99-0ded-486d-bf21-09908cf50d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.300412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91674e99-0ded-486d-bf21-09908cf50d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.300881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91674e99-0ded-486d-bf21-09908cf50d58 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f/users/7f6ea9c48af34ff08a498c9f779db002/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.303322 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91674e99-0ded-486d-bf21-09908cf50d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb37d41816d74f66a5087e325e84211f, user_id=7f6ea9c48af34ff08a498c9f779db002, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.306936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91674e99-0ded-486d-bf21-09908cf50d58 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.342689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 57/117] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:23:37 2021] PUT /identity/v3/projects/eb37d41816d74f66a5087e325e84211f/users/7f6ea9c48af34ff08a498c9f779db002/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:23:37.353508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbe921-95d0-4996-a13e-60b0736e329f None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.354177 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbe921-95d0-4996-a13e-60b0736e329f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.354664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbe921-95d0-4996-a13e-60b0736e329f None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.356749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 61/118] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:37.364284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f6e98-dfd7-4efb-bd3e-85da0ca87b12 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.364600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f6e98-dfd7-4efb-bd3e-85da0ca87b12 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.364838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f6e98-dfd7-4efb-bd3e-85da0ca87b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.391018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e12f6e98-dfd7-4efb-bd3e-85da0ca87b12 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:37.392236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e12f6e98-dfd7-4efb-bd3e-85da0ca87b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:37.463336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 58/119] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:37.505413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbe921-95d0-4996-a13e-60b0736e329f None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.524838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbe921-95d0-4996-a13e-60b0736e329f None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.535595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bc153-d706-4829-b3a4-ff7913476967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.536781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bc153-d706-4829-b3a4-ff7913476967 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.537269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bc153-d706-4829-b3a4-ff7913476967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.537782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bc153-d706-4829-b3a4-ff7913476967 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.550471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bc153-d706-4829-b3a4-ff7913476967 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:37.558210 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-419bc153-d706-4829-b3a4-ff7913476967 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:23:37.559802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 62/120] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/roles/reader => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:37.566724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f6e98-dfd7-4efb-bd3e-85da0ca87b12 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.576744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f6e98-dfd7-4efb-bd3e-85da0ca87b12 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.586782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14c2b6-efa3-4ec7-90f9-103a8b787e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.587815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14c2b6-efa3-4ec7-90f9-103a8b787e0a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.588322 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14c2b6-efa3-4ec7-90f9-103a8b787e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.588798 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14c2b6-efa3-4ec7-90f9-103a8b787e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.589818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14c2b6-efa3-4ec7-90f9-103a8b787e0a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:37.590340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14c2b6-efa3-4ec7-90f9-103a8b787e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.592221 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14c2b6-efa3-4ec7-90f9-103a8b787e0a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.603188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 59/121] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:37.609893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bc153-d706-4829-b3a4-ff7913476967 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.620532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bc153-d706-4829-b3a4-ff7913476967 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.635610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034a4a2-d7b3-451f-b69a-cc866239d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.636882 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034a4a2-d7b3-451f-b69a-cc866239d0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.637373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034a4a2-d7b3-451f-b69a-cc866239d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.637888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034a4a2-d7b3-451f-b69a-cc866239d0f2 admin admin] PATH_INFO: `/v3/users/0521578e967b4d8889d1df494188b737` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.665659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034a4a2-d7b3-451f-b69a-cc866239d0f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=0521578e967b4d8889d1df494188b737)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.667883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034a4a2-d7b3-451f-b69a-cc866239d0f2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.669805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 63/122] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/users/0521578e967b4d8889d1df494188b737 => generated 289 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:37.675948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14c2b6-efa3-4ec7-90f9-103a8b787e0a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.686709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14c2b6-efa3-4ec7-90f9-103a8b787e0a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.697631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5179a-5634-4582-bbbe-e5fc0d737aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.698330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5179a-5634-4582-bbbe-e5fc0d737aac admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.698622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5179a-5634-4582-bbbe-e5fc0d737aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.698904 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5179a-5634-4582-bbbe-e5fc0d737aac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.709685 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5179a-5634-4582-bbbe-e5fc0d737aac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.712048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5179a-5634-4582-bbbe-e5fc0d737aac admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.722386 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 60/123] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:37.729435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034a4a2-d7b3-451f-b69a-cc866239d0f2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.742876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034a4a2-d7b3-451f-b69a-cc866239d0f2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.747789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962964bf-228b-4842-b545-2ba94ae5da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.748818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962964bf-228b-4842-b545-2ba94ae5da00 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.749248 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962964bf-228b-4842-b545-2ba94ae5da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.749672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962964bf-228b-4842-b545-2ba94ae5da00 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.754620 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962964bf-228b-4842-b545-2ba94ae5da00 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.757059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962964bf-228b-4842-b545-2ba94ae5da00 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.759026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 64/124] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:37.765624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5179a-5634-4582-bbbe-e5fc0d737aac admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.775067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21801d4e-288a-4878-aff4-a08864cdd29a None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.775746 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21801d4e-288a-4878-aff4-a08864cdd29a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.778024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5179a-5634-4582-bbbe-e5fc0d737aac admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.779093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21801d4e-288a-4878-aff4-a08864cdd29a None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.786410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 65/125] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:37 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:37.790428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d20392-bb04-4a6e-9de0-bd19c852db8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.791368 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d20392-bb04-4a6e-9de0-bd19c852db8b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.791819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d20392-bb04-4a6e-9de0-bd19c852db8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.792242 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d20392-bb04-4a6e-9de0-bd19c852db8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.793267 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d20392-bb04-4a6e-9de0-bd19c852db8b admin admin] RBAC: Adding query filter params (role.id=2d4c3613503847f2bb3bf938420dfc1e, scope.project.id=eb37d41816d74f66a5087e325e84211f, user.id=0521578e967b4d8889d1df494188b737) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:37.793735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d20392-bb04-4a6e-9de0-bd19c852db8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.795851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d20392-bb04-4a6e-9de0-bd19c852db8b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.802160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b992a6d-399d-4ae5-ba64-7f6d8b532d61 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.802680 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b992a6d-399d-4ae5-ba64-7f6d8b532d61 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.803110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b992a6d-399d-4ae5-ba64-7f6d8b532d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.813248 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 61/126] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/role_assignments?user.id=0521578e967b4d8889d1df494188b737&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=2d4c3613503847f2bb3bf938420dfc1e => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:37.835538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-1b992a6d-399d-4ae5-ba64-7f6d8b532d61 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:37.837026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1b992a6d-399d-4ae5-ba64-7f6d8b532d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:37.845541 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 66/127] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:37.895334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d20392-bb04-4a6e-9de0-bd19c852db8b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.911233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d20392-bb04-4a6e-9de0-bd19c852db8b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.919343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b1cf3-677b-4807-a723-c32926c0fbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.920396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b1cf3-677b-4807-a723-c32926c0fbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.920840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b1cf3-677b-4807-a723-c32926c0fbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.921261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b1cf3-677b-4807-a723-c32926c0fbf9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.936201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b1cf3-677b-4807-a723-c32926c0fbf9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:37.943431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-015b1cf3-677b-4807-a723-c32926c0fbf9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:23:37.949875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 62/128] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:37.952090 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b992a6d-399d-4ae5-ba64-7f6d8b532d61 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:37.961934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b992a6d-399d-4ae5-ba64-7f6d8b532d61 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:37.970114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e449-0221-47c7-b80e-60c90f4d91c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:37.971096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e449-0221-47c7-b80e-60c90f4d91c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:37.971529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e449-0221-47c7-b80e-60c90f4d91c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:37.971953 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e449-0221-47c7-b80e-60c90f4d91c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:37.972901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1e449-0221-47c7-b80e-60c90f4d91c5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:37.973364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1e449-0221-47c7-b80e-60c90f4d91c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:37.975220 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1e449-0221-47c7-b80e-60c90f4d91c5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:37.986300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 67/129] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:37.992871 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b1cf3-677b-4807-a723-c32926c0fbf9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:38.007979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b1cf3-677b-4807-a723-c32926c0fbf9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:38.018203 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c8041-87ae-4a24-9cf7-24a1790cfdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:38.019375 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c8041-87ae-4a24-9cf7-24a1790cfdcb admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:38.019807 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c8041-87ae-4a24-9cf7-24a1790cfdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:38.020231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c8041-87ae-4a24-9cf7-24a1790cfdcb admin admin] PATH_INFO: `/v3/users/7f6ea9c48af34ff08a498c9f779db002` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:38.026665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c8041-87ae-4a24-9cf7-24a1790cfdcb admin admin] RBAC: Authorizing `identity:get_user(user_id=7f6ea9c48af34ff08a498c9f779db002)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:38.029076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c8041-87ae-4a24-9cf7-24a1790cfdcb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:38.031021 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 63/130] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:37 2021] GET /identity/v3/users/7f6ea9c48af34ff08a498c9f779db002 => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:38.037479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e449-0221-47c7-b80e-60c90f4d91c5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:38.048168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e449-0221-47c7-b80e-60c90f4d91c5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:38.058102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce8e65-08c1-4ae6-99cf-70b547fd4f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:38.058999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce8e65-08c1-4ae6-99cf-70b547fd4f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:38.059283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce8e65-08c1-4ae6-99cf-70b547fd4f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:38.059563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce8e65-08c1-4ae6-99cf-70b547fd4f3c admin admin] PATH_INFO: `/v3/projects/46ee13423f67497f839dafbe20f3f739` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:38.060832 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce8e65-08c1-4ae6-99cf-70b547fd4f3c admin admin] RBAC: Authorizing `identity:get_project(project_id=46ee13423f67497f839dafbe20f3f739)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:38.063010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce8e65-08c1-4ae6-99cf-70b547fd4f3c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:38.069901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 68/131] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:38 2021] GET /identity/v3/projects/46ee13423f67497f839dafbe20f3f739 => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:38.072126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c8041-87ae-4a24-9cf7-24a1790cfdcb admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:38.087872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c8041-87ae-4a24-9cf7-24a1790cfdcb admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:38.094565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf23f2f-a2d6-463d-a9fc-a0a69c896e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:38.095479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23f2f-a2d6-463d-a9fc-a0a69c896e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:38.095758 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23f2f-a2d6-463d-a9fc-a0a69c896e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:38.096033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23f2f-a2d6-463d-a9fc-a0a69c896e4c admin admin] PATH_INFO: `/v3/projects/46ee13423f67497f839dafbe20f3f739/users/7f6ea9c48af34ff08a498c9f779db002/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:38.103345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf23f2f-a2d6-463d-a9fc-a0a69c896e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ee13423f67497f839dafbe20f3f739, user_id=7f6ea9c48af34ff08a498c9f779db002, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:38.106068 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf23f2f-a2d6-463d-a9fc-a0a69c896e4c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:38.132731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 64/132] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:23:38 2021] PUT /identity/v3/projects/46ee13423f67497f839dafbe20f3f739/users/7f6ea9c48af34ff08a498c9f779db002/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:23:38.442509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568aa4-b93e-42cb-b077-cbdc1aea3006 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:38.443219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568aa4-b93e-42cb-b077-cbdc1aea3006 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:38.443704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568aa4-b93e-42cb-b077-cbdc1aea3006 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:38.446281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 69/133] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:38.452540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062fdf-b341-4f9f-93d4-edc5123791b9 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:38.452822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062fdf-b341-4f9f-93d4-edc5123791b9 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:38.453282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062fdf-b341-4f9f-93d4-edc5123791b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:38.481984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-51062fdf-b341-4f9f-93d4-edc5123791b9 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:38.483842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-51062fdf-b341-4f9f-93d4-edc5123791b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:38.570628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 65/134] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:38.607859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568aa4-b93e-42cb-b077-cbdc1aea3006 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:38.622064 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568aa4-b93e-42cb-b077-cbdc1aea3006 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:38.639267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302bc0c-0d45-4248-ad94-00757117046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:38.640094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302bc0c-0d45-4248-ad94-00757117046a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:38.640378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302bc0c-0d45-4248-ad94-00757117046a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:38.640656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302bc0c-0d45-4248-ad94-00757117046a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:38.641897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302bc0c-0d45-4248-ad94-00757117046a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:38.643692 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302bc0c-0d45-4248-ad94-00757117046a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:38.645616 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 70/135] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:38.651584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51062fdf-b341-4f9f-93d4-edc5123791b9 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:38.665942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51062fdf-b341-4f9f-93d4-edc5123791b9 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:38.673791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ce3eb-f025-4b62-9acb-dca888849bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:38.674705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ce3eb-f025-4b62-9acb-dca888849bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:38.675182 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ce3eb-f025-4b62-9acb-dca888849bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:38.675650 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ce3eb-f025-4b62-9acb-dca888849bb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:38.676595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ce3eb-f025-4b62-9acb-dca888849bb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:38.679310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ce3eb-f025-4b62-9acb-dca888849bb2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:38.732029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 66/136] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:23:38 2021] POST /identity/v3/projects => generated 302 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:23:40.680241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe542e-8ad7-4404-8027-26b0b6f39bc2 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:40.681181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe542e-8ad7-4404-8027-26b0b6f39bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:40.681658 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe542e-8ad7-4404-8027-26b0b6f39bc2 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:40.683957 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 71/137] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:40.690091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e695153-0231-4858-ab87-6d05def269be None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:40.690540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e695153-0231-4858-ab87-6d05def269be None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:40.690636 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e695153-0231-4858-ab87-6d05def269be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:40.714751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-5e695153-0231-4858-ab87-6d05def269be None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:40.715951 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-5e695153-0231-4858-ab87-6d05def269be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:40.734238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763fa98-ef44-428c-a8c2-49317ebaaa95 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:40.734844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763fa98-ef44-428c-a8c2-49317ebaaa95 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:40.735420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763fa98-ef44-428c-a8c2-49317ebaaa95 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:40.737627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 72/138] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:40.742877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a540e-2a3e-40b2-8611-476503d35ff7 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:40.743406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a540e-2a3e-40b2-8611-476503d35ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:40.743884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a540e-2a3e-40b2-8611-476503d35ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:40.769138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5c8a540e-2a3e-40b2-8611-476503d35ff7 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:40.770741 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5c8a540e-2a3e-40b2-8611-476503d35ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:40.816242 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 67/139] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:40.855438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e695153-0231-4858-ab87-6d05def269be None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:40.868178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e695153-0231-4858-ab87-6d05def269be None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:40.878302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac5fdd-f32c-4e8c-9028-31cb57da1fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:40.879114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac5fdd-f32c-4e8c-9028-31cb57da1fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:40.879394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac5fdd-f32c-4e8c-9028-31cb57da1fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:40.879668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac5fdd-f32c-4e8c-9028-31cb57da1fb7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:40.907207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 73/140] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:40.907367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac5fdd-f32c-4e8c-9028-31cb57da1fb7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:40.914597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-29ac5fdd-f32c-4e8c-9028-31cb57da1fb7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:23:40.915807 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 68/141] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:23:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:23:40.922202 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a540e-2a3e-40b2-8611-476503d35ff7 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:40.934984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a540e-2a3e-40b2-8611-476503d35ff7 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:40.944784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91732113-fa72-4fdc-be26-f4dfedc2e2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:40.945470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91732113-fa72-4fdc-be26-f4dfedc2e2cf admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:40.945767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91732113-fa72-4fdc-be26-f4dfedc2e2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:40.946058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91732113-fa72-4fdc-be26-f4dfedc2e2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:40.946830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91732113-fa72-4fdc-be26-f4dfedc2e2cf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:40.947132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91732113-fa72-4fdc-be26-f4dfedc2e2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:40.948742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91732113-fa72-4fdc-be26-f4dfedc2e2cf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:40.954014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac5fdd-f32c-4e8c-9028-31cb57da1fb7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:40.972137 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac5fdd-f32c-4e8c-9028-31cb57da1fb7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:40.973447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 74/142] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:23:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:40.979991 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91732113-fa72-4fdc-be26-f4dfedc2e2cf admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:40.986597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237aaeb-a164-40f4-8a78-19107db4a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:40.987430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237aaeb-a164-40f4-8a78-19107db4a4cd admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:40.987718 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237aaeb-a164-40f4-8a78-19107db4a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:40.987987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237aaeb-a164-40f4-8a78-19107db4a4cd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:40.995578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91732113-fa72-4fdc-be26-f4dfedc2e2cf admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.006276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075483a-da33-459a-9724-a273bae1914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.007198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075483a-da33-459a-9724-a273bae1914f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.007486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075483a-da33-459a-9724-a273bae1914f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.007769 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075483a-da33-459a-9724-a273bae1914f admin admin] PATH_INFO: `/v3/users/7f6ea9c48af34ff08a498c9f779db002` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.010857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075483a-da33-459a-9724-a273bae1914f admin admin] RBAC: Authorizing `identity:get_user(user_id=7f6ea9c48af34ff08a498c9f779db002)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.013223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075483a-da33-459a-9724-a273bae1914f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.015283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 75/143] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:40 2021] GET /identity/v3/users/7f6ea9c48af34ff08a498c9f779db002 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:41.019178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237aaeb-a164-40f4-8a78-19107db4a4cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:41.021128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075483a-da33-459a-9724-a273bae1914f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.039276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075483a-da33-459a-9724-a273bae1914f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.040015 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-b237aaeb-a164-40f4-8a78-19107db4a4cd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:23:41.041266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 69/144] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:41.047487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237aaeb-a164-40f4-8a78-19107db4a4cd admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.054895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4dd1f-f372-49bb-a4a1-95f46aacbf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.055568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4dd1f-f372-49bb-a4a1-95f46aacbf4d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.055859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4dd1f-f372-49bb-a4a1-95f46aacbf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.056143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4dd1f-f372-49bb-a4a1-95f46aacbf4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.072197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237aaeb-a164-40f4-8a78-19107db4a4cd admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.074650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4dd1f-f372-49bb-a4a1-95f46aacbf4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.076464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4dd1f-f372-49bb-a4a1-95f46aacbf4d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.082936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb978d2a-440f-4d85-a5bb-89a892ff0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.083984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb978d2a-440f-4d85-a5bb-89a892ff0ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.084488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb978d2a-440f-4d85-a5bb-89a892ff0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.085052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb978d2a-440f-4d85-a5bb-89a892ff0ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.086040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb978d2a-440f-4d85-a5bb-89a892ff0ce9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:41.086772 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb978d2a-440f-4d85-a5bb-89a892ff0ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.089394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb978d2a-440f-4d85-a5bb-89a892ff0ce9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.096834 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 76/145] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:41.098287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b9e7-c3d6-4ccf-a43e-b34bfbdf4a48 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.098744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b9e7-c3d6-4ccf-a43e-b34bfbdf4a48 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.104334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 70/146] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:41.104794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b9e7-c3d6-4ccf-a43e-b34bfbdf4a48 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.106767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb978d2a-440f-4d85-a5bb-89a892ff0ce9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.107069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 77/147] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:41 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:41.108792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8b9e7-c3d6-4ccf-a43e-b34bfbdf4a48 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.122852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb978d2a-440f-4d85-a5bb-89a892ff0ce9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.127480 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c114-f929-4c64-b212-6d36de694872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.128422 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c114-f929-4c64-b212-6d36de694872 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.128709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c114-f929-4c64-b212-6d36de694872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.128989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c114-f929-4c64-b212-6d36de694872 admin admin] PATH_INFO: `/v3/users/7f6ea9c48af34ff08a498c9f779db002` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.131000 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c114-f929-4c64-b212-6d36de694872 admin admin] RBAC: Authorizing `identity:get_user(user_id=7f6ea9c48af34ff08a498c9f779db002)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.133449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c114-f929-4c64-b212-6d36de694872 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.135496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 71/148] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/users/7f6ea9c48af34ff08a498c9f779db002 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:41.136953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c59084-bca7-4970-a75b-582e9689b85f None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.137244 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c59084-bca7-4970-a75b-582e9689b85f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.137570 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c59084-bca7-4970-a75b-582e9689b85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.138186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8b9e7-c3d6-4ccf-a43e-b34bfbdf4a48 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.155231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a66a-b7da-4afe-9bef-990a26548f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.156409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a66a-b7da-4afe-9bef-990a26548f06 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.156927 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a66a-b7da-4afe-9bef-990a26548f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.157281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-66c59084-bca7-4970-a75b-582e9689b85f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:41.157688 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a66a-b7da-4afe-9bef-990a26548f06 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.161777 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-66c59084-bca7-4970-a75b-582e9689b85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:41.162709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40a66a-b7da-4afe-9bef-990a26548f06 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.165503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40a66a-b7da-4afe-9bef-990a26548f06 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.168712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 78/149] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:41.169712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a66a-b7da-4afe-9bef-990a26548f06 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.173688 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 72/150] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:41.179479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c59084-bca7-4970-a75b-582e9689b85f None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.192593 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a66a-b7da-4afe-9bef-990a26548f06 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.203504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c59084-bca7-4970-a75b-582e9689b85f None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.207399 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0f4cf-4447-4c7f-8204-1b0537a35353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.209085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0f4cf-4447-4c7f-8204-1b0537a35353 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.209377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0f4cf-4447-4c7f-8204-1b0537a35353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.209662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0f4cf-4447-4c7f-8204-1b0537a35353 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.214440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7ca46-cf41-4422-a1f7-533f4512ea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.215158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ca46-cf41-4422-a1f7-533f4512ea58 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.215493 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ca46-cf41-4422-a1f7-533f4512ea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.215777 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ca46-cf41-4422-a1f7-533f4512ea58 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.222760 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7ca46-cf41-4422-a1f7-533f4512ea58 admin admin] RBAC: Adding query filter params (role.id=78ec5da190bd41768cafe7cade4d3d69, scope.project.id=eb37d41816d74f66a5087e325e84211f, user.id=7f6ea9c48af34ff08a498c9f779db002) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:41.223092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7ca46-cf41-4422-a1f7-533f4512ea58 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.228377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7ca46-cf41-4422-a1f7-533f4512ea58 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.236891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0f4cf-4447-4c7f-8204-1b0537a35353 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.240148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0f4cf-4447-4c7f-8204-1b0537a35353 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.243934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 73/151] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/role_assignments?user.id=7f6ea9c48af34ff08a498c9f779db002&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=78ec5da190bd41768cafe7cade4d3d69 => generated 608 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:41.244624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7ca46-cf41-4422-a1f7-533f4512ea58 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.264090 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 79/152] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:41.266732 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7ca46-cf41-4422-a1f7-533f4512ea58 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.268406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0f4cf-4447-4c7f-8204-1b0537a35353 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.281076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38080152-7c8e-4ab2-84fb-21b73f000da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.283953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080152-7c8e-4ab2-84fb-21b73f000da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.284291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080152-7c8e-4ab2-84fb-21b73f000da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.284571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080152-7c8e-4ab2-84fb-21b73f000da0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.285802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0f4cf-4447-4c7f-8204-1b0537a35353 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.298742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38080152-7c8e-4ab2-84fb-21b73f000da0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:41.306528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf543e1-4069-46f0-b421-ab2289b47c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.306752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-38080152-7c8e-4ab2-84fb-21b73f000da0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:23:41.307406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf543e1-4069-46f0-b421-ab2289b47c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.307933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf543e1-4069-46f0-b421-ab2289b47c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.308418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 74/153] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:41.308532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf543e1-4069-46f0-b421-ab2289b47c38 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.309539 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf543e1-4069-46f0-b421-ab2289b47c38 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.311860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf543e1-4069-46f0-b421-ab2289b47c38 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.314056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 80/154] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:41.314817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38080152-7c8e-4ab2-84fb-21b73f000da0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.322821 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf543e1-4069-46f0-b421-ab2289b47c38 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.328499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38080152-7c8e-4ab2-84fb-21b73f000da0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.341515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf543e1-4069-46f0-b421-ab2289b47c38 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.343553 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facde189-2343-42da-ad01-31f0e576d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.344261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facde189-2343-42da-ad01-31f0e576d079 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.344541 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facde189-2343-42da-ad01-31f0e576d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.344818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facde189-2343-42da-ad01-31f0e576d079 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.345627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facde189-2343-42da-ad01-31f0e576d079 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:41.346084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facde189-2343-42da-ad01-31f0e576d079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.347869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facde189-2343-42da-ad01-31f0e576d079 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.350049 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92624a91-8eee-4082-8fc1-493390dff915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.351434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92624a91-8eee-4082-8fc1-493390dff915 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.351718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92624a91-8eee-4082-8fc1-493390dff915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.351992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92624a91-8eee-4082-8fc1-493390dff915 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.352921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92624a91-8eee-4082-8fc1-493390dff915 admin admin] RBAC: Adding query filter params (role.id=78401ee743b448d48b6c94ff8642907e, scope.project.id=eb37d41816d74f66a5087e325e84211f, user.id=7f6ea9c48af34ff08a498c9f779db002) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:41.353290 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92624a91-8eee-4082-8fc1-493390dff915 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.355340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92624a91-8eee-4082-8fc1-493390dff915 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.364120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 75/155] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:41.371049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facde189-2343-42da-ad01-31f0e576d079 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.372254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 81/156] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/role_assignments?user.id=7f6ea9c48af34ff08a498c9f779db002&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=78401ee743b448d48b6c94ff8642907e => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:41.382086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facde189-2343-42da-ad01-31f0e576d079 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.394244 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8f272-fdb1-4e7f-b074-118e3f23088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.395179 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8f272-fdb1-4e7f-b074-118e3f23088d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.395457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8f272-fdb1-4e7f-b074-118e3f23088d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.395729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8f272-fdb1-4e7f-b074-118e3f23088d admin admin] PATH_INFO: `/v3/users/df51193f4ede4e77a3f00ac4e0205892` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.397208 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8f272-fdb1-4e7f-b074-118e3f23088d admin admin] RBAC: Authorizing `identity:get_user(user_id=df51193f4ede4e77a3f00ac4e0205892)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.399715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8f272-fdb1-4e7f-b074-118e3f23088d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.401842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 76/157] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/users/df51193f4ede4e77a3f00ac4e0205892 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:41.408135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92624a91-8eee-4082-8fc1-493390dff915 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.424751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92624a91-8eee-4082-8fc1-493390dff915 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.433494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa552e-a3c4-424e-a09b-ca2214a83f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.434205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa552e-a3c4-424e-a09b-ca2214a83f8c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.434544 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa552e-a3c4-424e-a09b-ca2214a83f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.434826 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa552e-a3c4-424e-a09b-ca2214a83f8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.449020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa552e-a3c4-424e-a09b-ca2214a83f8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.450947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa552e-a3c4-424e-a09b-ca2214a83f8c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.465356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 82/158] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:41.471669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8f272-fdb1-4e7f-b074-118e3f23088d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.488262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8f272-fdb1-4e7f-b074-118e3f23088d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.503624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13e326-5ac5-432a-b3fc-6ded9f5f3195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.504542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e326-5ac5-432a-b3fc-6ded9f5f3195 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.504824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e326-5ac5-432a-b3fc-6ded9f5f3195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.505098 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e326-5ac5-432a-b3fc-6ded9f5f3195 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.506541 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13e326-5ac5-432a-b3fc-6ded9f5f3195 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.508784 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13e326-5ac5-432a-b3fc-6ded9f5f3195 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.510696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 77/159] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:41.517549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa552e-a3c4-424e-a09b-ca2214a83f8c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.532441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa552e-a3c4-424e-a09b-ca2214a83f8c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.539506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057241-dc55-4f2e-b816-d386fc22ef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.540168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057241-dc55-4f2e-b816-d386fc22ef2a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.540446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057241-dc55-4f2e-b816-d386fc22ef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.540718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057241-dc55-4f2e-b816-d386fc22ef2a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.541629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057241-dc55-4f2e-b816-d386fc22ef2a admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=eb37d41816d74f66a5087e325e84211f, user.id=df51193f4ede4e77a3f00ac4e0205892) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:41.541960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057241-dc55-4f2e-b816-d386fc22ef2a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.543822 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057241-dc55-4f2e-b816-d386fc22ef2a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.555351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 83/160] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/role_assignments?user.id=df51193f4ede4e77a3f00ac4e0205892&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=a312b345efeb490eb4234d1ace386dec => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:41.761628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079f6f3-6ab6-446f-8520-98f705d728c2 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.762552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079f6f3-6ab6-446f-8520-98f705d728c2 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.763034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079f6f3-6ab6-446f-8520-98f705d728c2 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.765080 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 78/161] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:41.771527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ec16a-13d1-4f76-86e9-867e60a46caa None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.772015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ec16a-13d1-4f76-86e9-867e60a46caa None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.772088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ec16a-13d1-4f76-86e9-867e60a46caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.798306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d37ec16a-13d1-4f76-86e9-867e60a46caa None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:41.799708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d37ec16a-13d1-4f76-86e9-867e60a46caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:41.812343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 84/162] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:41.844252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079f6f3-6ab6-446f-8520-98f705d728c2 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.862240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079f6f3-6ab6-446f-8520-98f705d728c2 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.867864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fb5a8-0f75-4b7f-9afc-bc52e0335a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.868692 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fb5a8-0f75-4b7f-9afc-bc52e0335a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.868974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fb5a8-0f75-4b7f-9afc-bc52e0335a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.869249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fb5a8-0f75-4b7f-9afc-bc52e0335a73 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.884378 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fb5a8-0f75-4b7f-9afc-bc52e0335a73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:41.891993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-5b9fb5a8-0f75-4b7f-9afc-bc52e0335a73 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:23:41.893269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 79/163] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:41.900400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ec16a-13d1-4f76-86e9-867e60a46caa None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.915438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ec16a-13d1-4f76-86e9-867e60a46caa None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.924170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab19a21-b918-46d0-9ce5-27ba655b586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.925188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab19a21-b918-46d0-9ce5-27ba655b586d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.925640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab19a21-b918-46d0-9ce5-27ba655b586d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.926101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab19a21-b918-46d0-9ce5-27ba655b586d admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.927060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab19a21-b918-46d0-9ce5-27ba655b586d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:41.927546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab19a21-b918-46d0-9ce5-27ba655b586d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.929431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab19a21-b918-46d0-9ce5-27ba655b586d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.944960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 85/164] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:41.951739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fb5a8-0f75-4b7f-9afc-bc52e0335a73 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.952718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa3129-dfca-43a4-9987-97c218fbec6f None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.953014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa3129-dfca-43a4-9987-97c218fbec6f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.953296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa3129-dfca-43a4-9987-97c218fbec6f None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.955109 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 86/165] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:41.962936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581537-fda2-4d21-9faa-a41e19b0880e None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.963300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581537-fda2-4d21-9faa-a41e19b0880e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.963542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581537-fda2-4d21-9faa-a41e19b0880e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.966191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fb5a8-0f75-4b7f-9afc-bc52e0335a73 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:41.971564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57071a-4396-4573-b94a-593691a8a681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:41.972576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57071a-4396-4573-b94a-593691a8a681 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:41.972905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57071a-4396-4573-b94a-593691a8a681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:41.973181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57071a-4396-4573-b94a-593691a8a681 admin admin] PATH_INFO: `/v3/users/7f6ea9c48af34ff08a498c9f779db002` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:41.974545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57071a-4396-4573-b94a-593691a8a681 admin admin] RBAC: Authorizing `identity:get_user(user_id=7f6ea9c48af34ff08a498c9f779db002)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:41.976939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57071a-4396-4573-b94a-593691a8a681 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:41.979049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 80/166] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/users/7f6ea9c48af34ff08a498c9f779db002 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:41.984897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-f1581537-fda2-4d21-9faa-a41e19b0880e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:41.985071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57071a-4396-4573-b94a-593691a8a681 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:41.986134 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f1581537-fda2-4d21-9faa-a41e19b0880e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:41.999906 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57071a-4396-4573-b94a-593691a8a681 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:42.000348 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 87/167] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:42.005675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97db89-da75-4b8f-85fb-a2d1fbf6df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:42.006672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97db89-da75-4b8f-85fb-a2d1fbf6df87 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.007697 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97db89-da75-4b8f-85fb-a2d1fbf6df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.008135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97db89-da75-4b8f-85fb-a2d1fbf6df87 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.017618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97db89-da75-4b8f-85fb-a2d1fbf6df87 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:42.019750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97db89-da75-4b8f-85fb-a2d1fbf6df87 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:42.027239 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1581537-fda2-4d21-9faa-a41e19b0880e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:42.032843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 81/168] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:42.039143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1581537-fda2-4d21-9faa-a41e19b0880e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:42.039488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97db89-da75-4b8f-85fb-a2d1fbf6df87 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:42.046398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7a0da-97d3-4e37-a7a5-2fd635fe2e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:42.047225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7a0da-97d3-4e37-a7a5-2fd635fe2e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.047509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7a0da-97d3-4e37-a7a5-2fd635fe2e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.047786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7a0da-97d3-4e37-a7a5-2fd635fe2e34 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.049662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97db89-da75-4b8f-85fb-a2d1fbf6df87 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:42.058693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1257f1-1b1d-48af-b881-cab69297b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:42.059773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1257f1-1b1d-48af-b881-cab69297b0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.059953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1257f1-1b1d-48af-b881-cab69297b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.060197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1257f1-1b1d-48af-b881-cab69297b0c5 admin admin] PATH_INFO: `/v3/projects/46ee13423f67497f839dafbe20f3f739` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.061948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1257f1-1b1d-48af-b881-cab69297b0c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=46ee13423f67497f839dafbe20f3f739)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:42.064555 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1257f1-1b1d-48af-b881-cab69297b0c5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:42.064707 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7a0da-97d3-4e37-a7a5-2fd635fe2e34 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:42.066524 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 82/169] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:42 2021] GET /identity/v3/projects/46ee13423f67497f839dafbe20f3f739 => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:42.073004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-f8b7a0da-97d3-4e37-a7a5-2fd635fe2e34 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:23:42.073387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1257f1-1b1d-48af-b881-cab69297b0c5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:42.074662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 88/170] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:42 2021] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:23:42.080735 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7a0da-97d3-4e37-a7a5-2fd635fe2e34 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:42.084476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1257f1-1b1d-48af-b881-cab69297b0c5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:42.091725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7a0da-97d3-4e37-a7a5-2fd635fe2e34 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:42.092940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db59ce-08c2-4dec-886e-61f2126b9a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:42.093658 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db59ce-08c2-4dec-886e-61f2126b9a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.094076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db59ce-08c2-4dec-886e-61f2126b9a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.094365 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db59ce-08c2-4dec-886e-61f2126b9a10 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.095315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db59ce-08c2-4dec-886e-61f2126b9a10 admin admin] RBAC: Adding query filter params (role.id=78401ee743b448d48b6c94ff8642907e, scope.project.id=46ee13423f67497f839dafbe20f3f739, user.id=7f6ea9c48af34ff08a498c9f779db002) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:42.095680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db59ce-08c2-4dec-886e-61f2126b9a10 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:42.097687 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db59ce-08c2-4dec-886e-61f2126b9a10 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:42.097934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8fc3b-64c0-4da7-ad18-8cd926054e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:42.098794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8fc3b-64c0-4da7-ad18-8cd926054e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.099245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8fc3b-64c0-4da7-ad18-8cd926054e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.099689 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8fc3b-64c0-4da7-ad18-8cd926054e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.100675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8fc3b-64c0-4da7-ad18-8cd926054e54 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:42.101467 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8fc3b-64c0-4da7-ad18-8cd926054e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:42.102600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8fc3b-64c0-4da7-ad18-8cd926054e54 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:42.105045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 83/171] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:42 2021] GET /identity/v3/role_assignments?user.id=7f6ea9c48af34ff08a498c9f779db002&scope.project.id=46ee13423f67497f839dafbe20f3f739&role.id=78401ee743b448d48b6c94ff8642907e => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:42.111854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 89/172] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:42 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:42.118669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db59ce-08c2-4dec-886e-61f2126b9a10 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:42.129294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db59ce-08c2-4dec-886e-61f2126b9a10 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:42.134496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487397a0-653b-4bdd-a480-41709c19306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:42.135404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487397a0-653b-4bdd-a480-41709c19306a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.135682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487397a0-653b-4bdd-a480-41709c19306a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.135957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487397a0-653b-4bdd-a480-41709c19306a admin admin] PATH_INFO: `/v3/users/0521578e967b4d8889d1df494188b737` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.137251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487397a0-653b-4bdd-a480-41709c19306a admin admin] RBAC: Authorizing `identity:get_user(user_id=0521578e967b4d8889d1df494188b737)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:42.139450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487397a0-653b-4bdd-a480-41709c19306a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:42.141528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 84/173] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:42 2021] GET /identity/v3/users/0521578e967b4d8889d1df494188b737 => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:42.147438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8fc3b-64c0-4da7-ad18-8cd926054e54 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:42.157443 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8fc3b-64c0-4da7-ad18-8cd926054e54 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:42.162012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854e79e-8b7e-401b-83ab-8c32c91ecfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:42.162947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854e79e-8b7e-401b-83ab-8c32c91ecfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.163238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854e79e-8b7e-401b-83ab-8c32c91ecfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.163513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854e79e-8b7e-401b-83ab-8c32c91ecfd0 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.164818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854e79e-8b7e-401b-83ab-8c32c91ecfd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:42.166969 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854e79e-8b7e-401b-83ab-8c32c91ecfd0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:42.169288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 90/174] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:42 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:42.180439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487397a0-653b-4bdd-a480-41709c19306a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:42.191810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487397a0-653b-4bdd-a480-41709c19306a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:42.196894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95705240-9ca7-4ebc-92c9-c790837dec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:42.197868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705240-9ca7-4ebc-92c9-c790837dec2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.198162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705240-9ca7-4ebc-92c9-c790837dec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.198436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705240-9ca7-4ebc-92c9-c790837dec2c admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f/users/0521578e967b4d8889d1df494188b737/roles/2d4c3613503847f2bb3bf938420dfc1e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.200505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95705240-9ca7-4ebc-92c9-c790837dec2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb37d41816d74f66a5087e325e84211f, user_id=0521578e967b4d8889d1df494188b737, role_id=2d4c3613503847f2bb3bf938420dfc1e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:42.203272 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95705240-9ca7-4ebc-92c9-c790837dec2c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:42.218578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 85/175] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:23:42 2021] PUT /identity/v3/projects/eb37d41816d74f66a5087e325e84211f/users/0521578e967b4d8889d1df494188b737/roles/2d4c3613503847f2bb3bf938420dfc1e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:23:42.539103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed10d35-14b4-4302-98e1-afca8687592c None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.539574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed10d35-14b4-4302-98e1-afca8687592c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.539986 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed10d35-14b4-4302-98e1-afca8687592c None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.542259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 91/176] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:42.550523 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58860-ed9e-4941-8657-c2f43afd8e9a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.551045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58860-ed9e-4941-8657-c2f43afd8e9a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.551586 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58860-ed9e-4941-8657-c2f43afd8e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.581525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-a9d58860-ed9e-4941-8657-c2f43afd8e9a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:42.582887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a9d58860-ed9e-4941-8657-c2f43afd8e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:42.646145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 86/177] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:42.671999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed10d35-14b4-4302-98e1-afca8687592c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:42.686162 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed10d35-14b4-4302-98e1-afca8687592c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:42.690601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad296882-49c4-44a7-8f68-e044cbb84944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:42.691547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad296882-49c4-44a7-8f68-e044cbb84944 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.691854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad296882-49c4-44a7-8f68-e044cbb84944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.692187 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad296882-49c4-44a7-8f68-e044cbb84944 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.693384 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad296882-49c4-44a7-8f68-e044cbb84944 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:42.695651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad296882-49c4-44a7-8f68-e044cbb84944 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:42.697295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 92/178] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:42.703939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d58860-ed9e-4941-8657-c2f43afd8e9a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:42.718599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d58860-ed9e-4941-8657-c2f43afd8e9a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:42.723388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d86e91-78b8-4cf4-93a5-295ecf1a9c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:42.724055 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d86e91-78b8-4cf4-93a5-295ecf1a9c50 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:42.724329 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d86e91-78b8-4cf4-93a5-295ecf1a9c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:42.724599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d86e91-78b8-4cf4-93a5-295ecf1a9c50 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:42.725336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d86e91-78b8-4cf4-93a5-295ecf1a9c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:42.727439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d86e91-78b8-4cf4-93a5-295ecf1a9c50 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:42.758315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 87/179] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:23:42 2021] POST /identity/v3/users => generated 283 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:23:44.663936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b7275-23f5-4b99-89cb-327b8c07167c None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:44.664355 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b7275-23f5-4b99-89cb-327b8c07167c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:44.664540 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b7275-23f5-4b99-89cb-327b8c07167c None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:44.666628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 93/180] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:44.672431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60de83-0e1e-4f57-a9b8-066a99ce8ad7 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:44.672819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60de83-0e1e-4f57-a9b8-066a99ce8ad7 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:44.672991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60de83-0e1e-4f57-a9b8-066a99ce8ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:44.691159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-ef60de83-0e1e-4f57-a9b8-066a99ce8ad7 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:44.692339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ef60de83-0e1e-4f57-a9b8-066a99ce8ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:44.700489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 88/181] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:44.724849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b7275-23f5-4b99-89cb-327b8c07167c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:44.737311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b7275-23f5-4b99-89cb-327b8c07167c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:44.741675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7744ec9-d345-4f68-9dca-9af351b6a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:44.742518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7744ec9-d345-4f68-9dca-9af351b6a934 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:44.742798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7744ec9-d345-4f68-9dca-9af351b6a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:44.743072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7744ec9-d345-4f68-9dca-9af351b6a934 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:44.753730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7744ec9-d345-4f68-9dca-9af351b6a934 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:44.761151 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-a7744ec9-d345-4f68-9dca-9af351b6a934 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:23:44.762603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 94/182] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:44 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:44.768908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60de83-0e1e-4f57-a9b8-066a99ce8ad7 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:44.778506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60de83-0e1e-4f57-a9b8-066a99ce8ad7 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:44.783096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60280f-822d-403f-9115-405a75223e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:44.783757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60280f-822d-403f-9115-405a75223e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:44.784034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60280f-822d-403f-9115-405a75223e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:44.784305 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60280f-822d-403f-9115-405a75223e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:44.785066 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60280f-822d-403f-9115-405a75223e81 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:44.785370 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60280f-822d-403f-9115-405a75223e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:44.786991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60280f-822d-403f-9115-405a75223e81 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:44.795442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 89/183] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:44 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:44.801388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7744ec9-d345-4f68-9dca-9af351b6a934 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:44.816113 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7744ec9-d345-4f68-9dca-9af351b6a934 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:44.821158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865a704-ac71-4dc1-a2f7-2f93df5d1521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:44.822048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865a704-ac71-4dc1-a2f7-2f93df5d1521 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:44.822325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865a704-ac71-4dc1-a2f7-2f93df5d1521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:44.822597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865a704-ac71-4dc1-a2f7-2f93df5d1521 admin admin] PATH_INFO: `/v3/users/0521578e967b4d8889d1df494188b737` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:44.823807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865a704-ac71-4dc1-a2f7-2f93df5d1521 admin admin] RBAC: Authorizing `identity:get_user(user_id=0521578e967b4d8889d1df494188b737)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:44.825988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865a704-ac71-4dc1-a2f7-2f93df5d1521 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:44.827807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 95/184] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:44 2021] GET /identity/v3/users/0521578e967b4d8889d1df494188b737 => generated 289 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:44.833822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60280f-822d-403f-9115-405a75223e81 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:44.844767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60280f-822d-403f-9115-405a75223e81 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:44.849437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978df0ca-d417-47e0-938f-b5108e29e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:44.850151 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df0ca-d417-47e0-938f-b5108e29e907 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:44.850468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df0ca-d417-47e0-938f-b5108e29e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:44.850741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df0ca-d417-47e0-938f-b5108e29e907 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:44.859850 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978df0ca-d417-47e0-938f-b5108e29e907 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:44.861673 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978df0ca-d417-47e0-938f-b5108e29e907 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:44.872166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 90/185] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:44.878573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865a704-ac71-4dc1-a2f7-2f93df5d1521 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:44.889108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865a704-ac71-4dc1-a2f7-2f93df5d1521 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:44.893618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71a12c-6d51-4d6f-bb31-d6d1440cd0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:44.894518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71a12c-6d51-4d6f-bb31-d6d1440cd0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:44.894791 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71a12c-6d51-4d6f-bb31-d6d1440cd0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:44.895052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71a12c-6d51-4d6f-bb31-d6d1440cd0f6 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:44.896263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71a12c-6d51-4d6f-bb31-d6d1440cd0f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:44.898939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71a12c-6d51-4d6f-bb31-d6d1440cd0f6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:44.900883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 96/186] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:44 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:44.907467 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978df0ca-d417-47e0-938f-b5108e29e907 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:44.916699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978df0ca-d417-47e0-938f-b5108e29e907 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:44.921490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89539b69-cd6f-4224-9753-6ce2c87f611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:44.922223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539b69-cd6f-4224-9753-6ce2c87f611d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:44.922505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539b69-cd6f-4224-9753-6ce2c87f611d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:44.922784 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539b69-cd6f-4224-9753-6ce2c87f611d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:44.923678 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89539b69-cd6f-4224-9753-6ce2c87f611d admin admin] RBAC: Adding query filter params (role.id=2d4c3613503847f2bb3bf938420dfc1e, scope.project.id=eb37d41816d74f66a5087e325e84211f, user.id=0521578e967b4d8889d1df494188b737) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:44.923994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89539b69-cd6f-4224-9753-6ce2c87f611d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:44.925974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89539b69-cd6f-4224-9753-6ce2c87f611d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:44.934952 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 91/187] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:44 2021] GET /identity/v3/role_assignments?user.id=0521578e967b4d8889d1df494188b737&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=2d4c3613503847f2bb3bf938420dfc1e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:45.302554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206faf9-b4fd-49d4-b0b8-425c7fce0592 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.302736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206faf9-b4fd-49d4-b0b8-425c7fce0592 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.303133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206faf9-b4fd-49d4-b0b8-425c7fce0592 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.305731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 97/188] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:45.311932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16395d50-ae52-4557-918c-a651b7913e97 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.312226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16395d50-ae52-4557-918c-a651b7913e97 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.312510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16395d50-ae52-4557-918c-a651b7913e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.333432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-16395d50-ae52-4557-918c-a651b7913e97 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:45.334645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-16395d50-ae52-4557-918c-a651b7913e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:45.342431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 92/189] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:45.344393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd514e4-4a21-4008-986c-9a29852ff3a7 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.344683 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd514e4-4a21-4008-986c-9a29852ff3a7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.344962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd514e4-4a21-4008-986c-9a29852ff3a7 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.346750 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 98/190] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:45.353317 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4052-b676-4037-9629-82a61a8ccf76 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.353603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4052-b676-4037-9629-82a61a8ccf76 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.353908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4052-b676-4037-9629-82a61a8ccf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.368410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd514e4-4a21-4008-986c-9a29852ff3a7 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.374196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-777a4052-b676-4037-9629-82a61a8ccf76 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:45.375374 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-777a4052-b676-4037-9629-82a61a8ccf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:45.381303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd514e4-4a21-4008-986c-9a29852ff3a7 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.387796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 93/191] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:45.390223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6a059-8fcf-4a06-bd43-9eb33e8341a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.391655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6a059-8fcf-4a06-bd43-9eb33e8341a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.391655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6a059-8fcf-4a06-bd43-9eb33e8341a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.391655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6a059-8fcf-4a06-bd43-9eb33e8341a5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.406190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6a059-8fcf-4a06-bd43-9eb33e8341a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:45.411081 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a4052-b676-4037-9629-82a61a8ccf76 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.413602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-04e6a059-8fcf-4a06-bd43-9eb33e8341a5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:23:45.415032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 99/192] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:23:45.421661 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6a059-8fcf-4a06-bd43-9eb33e8341a5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.423069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a4052-b676-4037-9629-82a61a8ccf76 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.427409 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab092284-4854-4399-b7d2-43ee2e08efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.428235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab092284-4854-4399-b7d2-43ee2e08efe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.428615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab092284-4854-4399-b7d2-43ee2e08efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.429418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab092284-4854-4399-b7d2-43ee2e08efe6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.432599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6a059-8fcf-4a06-bd43-9eb33e8341a5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.437338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48de8-16d0-4da5-81fd-eb0a71aa0086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.438044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48de8-16d0-4da5-81fd-eb0a71aa0086 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.438325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48de8-16d0-4da5-81fd-eb0a71aa0086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.438824 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48de8-16d0-4da5-81fd-eb0a71aa0086 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.439373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c48de8-16d0-4da5-81fd-eb0a71aa0086 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:45.439677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c48de8-16d0-4da5-81fd-eb0a71aa0086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.440691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab092284-4854-4399-b7d2-43ee2e08efe6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:45.441306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c48de8-16d0-4da5-81fd-eb0a71aa0086 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.448438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-ab092284-4854-4399-b7d2-43ee2e08efe6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:23:45.449901 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 94/193] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:23:45.451255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 100/194] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:45.455796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab092284-4854-4399-b7d2-43ee2e08efe6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.456789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48de8-16d0-4da5-81fd-eb0a71aa0086 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.465743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab092284-4854-4399-b7d2-43ee2e08efe6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.466440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48de8-16d0-4da5-81fd-eb0a71aa0086 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.470755 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81dbd2-0a54-451a-a149-8064acee2df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.471620 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81dbd2-0a54-451a-a149-8064acee2df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.471769 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2aa6-13de-4ea6-a3c0-5df7d500adb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.471972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81dbd2-0a54-451a-a149-8064acee2df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.472144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81dbd2-0a54-451a-a149-8064acee2df5 admin admin] PATH_INFO: `/v3/users/e4516ff906e844739274b021ee36d50a` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.472405 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2aa6-13de-4ea6-a3c0-5df7d500adb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.472681 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2aa6-13de-4ea6-a3c0-5df7d500adb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.472966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2aa6-13de-4ea6-a3c0-5df7d500adb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.473690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2aa6-13de-4ea6-a3c0-5df7d500adb8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:45.474374 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2aa6-13de-4ea6-a3c0-5df7d500adb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.476144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2aa6-13de-4ea6-a3c0-5df7d500adb8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.485223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 95/195] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:45.488671 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81dbd2-0a54-451a-a149-8064acee2df5 admin admin] RBAC: Authorizing `identity:get_user(user_id=e4516ff906e844739274b021ee36d50a)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.490951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81dbd2-0a54-451a-a149-8064acee2df5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.491936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2aa6-13de-4ea6-a3c0-5df7d500adb8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.493450 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 101/196] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/users/e4516ff906e844739274b021ee36d50a => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:45.499150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81dbd2-0a54-451a-a149-8064acee2df5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.501766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2aa6-13de-4ea6-a3c0-5df7d500adb8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.506191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485e92c-4dcc-4428-bae5-c82bf8a08c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.507102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485e92c-4dcc-4428-bae5-c82bf8a08c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.507375 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485e92c-4dcc-4428-bae5-c82bf8a08c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.507637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485e92c-4dcc-4428-bae5-c82bf8a08c99 admin admin] PATH_INFO: `/v3/users/e4516ff906e844739274b021ee36d50a` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.508848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485e92c-4dcc-4428-bae5-c82bf8a08c99 admin admin] RBAC: Authorizing `identity:get_user(user_id=e4516ff906e844739274b021ee36d50a)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.509244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81dbd2-0a54-451a-a149-8064acee2df5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.511132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485e92c-4dcc-4428-bae5-c82bf8a08c99 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.512899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 96/197] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/users/e4516ff906e844739274b021ee36d50a => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:45.513663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e198c-7cf5-4463-a381-991726ed944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.514348 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e198c-7cf5-4463-a381-991726ed944d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.514627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e198c-7cf5-4463-a381-991726ed944d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.514900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e198c-7cf5-4463-a381-991726ed944d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.518645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485e92c-4dcc-4428-bae5-c82bf8a08c99 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.523527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e198c-7cf5-4463-a381-991726ed944d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.525279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e198c-7cf5-4463-a381-991726ed944d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.529274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485e92c-4dcc-4428-bae5-c82bf8a08c99 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.534482 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b4bb3-3094-4730-877f-022e301cade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.534817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 102/198] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:23:45.536280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc72f5-9416-4710-842d-74f101929543 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.536560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc72f5-9416-4710-842d-74f101929543 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.536835 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc72f5-9416-4710-842d-74f101929543 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.538697 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4bb3-3094-4730-877f-022e301cade3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.539286 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 103/199] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:45.539434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4bb3-3094-4730-877f-022e301cade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.539673 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4bb3-3094-4730-877f-022e301cade3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.541183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc72f5-9416-4710-842d-74f101929543 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.549748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b4bb3-3094-4730-877f-022e301cade3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.551723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b4bb3-3094-4730-877f-022e301cade3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.554389 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc72f5-9416-4710-842d-74f101929543 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.559013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7ba9e-d265-422d-9a13-38ca83851f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.559859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7ba9e-d265-422d-9a13-38ca83851f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.560140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7ba9e-d265-422d-9a13-38ca83851f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.560405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7ba9e-d265-422d-9a13-38ca83851f01 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.561596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7ba9e-d265-422d-9a13-38ca83851f01 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.563198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 97/200] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:23:45.568344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7ba9e-d265-422d-9a13-38ca83851f01 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.568464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d46d-d4ab-4cfb-a1c6-ff6aa728439b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.568464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d46d-d4ab-4cfb-a1c6-ff6aa728439b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.568464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d46d-d4ab-4cfb-a1c6-ff6aa728439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.568639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 104/201] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:45.572691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7ba9e-d265-422d-9a13-38ca83851f01 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.581096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7ba9e-d265-422d-9a13-38ca83851f01 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.582754 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-bc14d46d-d4ab-4cfb-a1c6-ff6aa728439b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:45.583946 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-bc14d46d-d4ab-4cfb-a1c6-ff6aa728439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:45.585433 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380975c-1d06-4a4b-9a93-e570e0a61d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.586319 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380975c-1d06-4a4b-9a93-e570e0a61d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.586602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380975c-1d06-4a4b-9a93-e570e0a61d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.586878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380975c-1d06-4a4b-9a93-e570e0a61d75 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.588040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380975c-1d06-4a4b-9a93-e570e0a61d75 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.590079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380975c-1d06-4a4b-9a93-e570e0a61d75 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.591777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 105/202] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:45.592529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380975c-1d06-4a4b-9a93-e570e0a61d75 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.603785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 98/203] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:45.603785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14d46d-d4ab-4cfb-a1c6-ff6aa728439b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.604009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380975c-1d06-4a4b-9a93-e570e0a61d75 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.608354 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8022c4c-986e-4ec4-a81d-5b730a3ceefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.610203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8022c4c-986e-4ec4-a81d-5b730a3ceefe admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.610330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14d46d-d4ab-4cfb-a1c6-ff6aa728439b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.610410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8022c4c-986e-4ec4-a81d-5b730a3ceefe admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.610410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8022c4c-986e-4ec4-a81d-5b730a3ceefe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.610573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8022c4c-986e-4ec4-a81d-5b730a3ceefe admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4, user.id=e4516ff906e844739274b021ee36d50a) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:45.610889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8022c4c-986e-4ec4-a81d-5b730a3ceefe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.612727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8022c4c-986e-4ec4-a81d-5b730a3ceefe admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.614752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14207a91-1f8e-4a13-a2c9-f1578cf27999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.615379 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14207a91-1f8e-4a13-a2c9-f1578cf27999 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.615609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14207a91-1f8e-4a13-a2c9-f1578cf27999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.617110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14207a91-1f8e-4a13-a2c9-f1578cf27999 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.617295 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14207a91-1f8e-4a13-a2c9-f1578cf27999 admin admin] RBAC: Adding query filter params (role.id=78ec5da190bd41768cafe7cade4d3d69, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4, user.id=e4516ff906e844739274b021ee36d50a) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:45.617622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14207a91-1f8e-4a13-a2c9-f1578cf27999 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.619458 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14207a91-1f8e-4a13-a2c9-f1578cf27999 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.619763 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 106/204] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/role_assignments?user.id=e4516ff906e844739274b021ee36d50a&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=a312b345efeb490eb4234d1ace386dec => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:45.629472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 99/205] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/role_assignments?user.id=e4516ff906e844739274b021ee36d50a&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=78ec5da190bd41768cafe7cade4d3d69 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:45.630302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8022c4c-986e-4ec4-a81d-5b730a3ceefe admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.641142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8022c4c-986e-4ec4-a81d-5b730a3ceefe admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.645961 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c887aa6-ef8a-42d6-89c5-2d33e8bb0a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.646814 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c887aa6-ef8a-42d6-89c5-2d33e8bb0a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.647097 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c887aa6-ef8a-42d6-89c5-2d33e8bb0a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.647419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c887aa6-ef8a-42d6-89c5-2d33e8bb0a23 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.648890 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c887aa6-ef8a-42d6-89c5-2d33e8bb0a23 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.653911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c887aa6-ef8a-42d6-89c5-2d33e8bb0a23 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.653911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 107/206] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:45.663754 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14207a91-1f8e-4a13-a2c9-f1578cf27999 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:45.674226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14207a91-1f8e-4a13-a2c9-f1578cf27999 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:45.679582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76729186-f8d9-4e33-a39e-62453eb715fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:45.680387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76729186-f8d9-4e33-a39e-62453eb715fb admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:45.680735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76729186-f8d9-4e33-a39e-62453eb715fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:45.681065 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76729186-f8d9-4e33-a39e-62453eb715fb admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:45.681975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76729186-f8d9-4e33-a39e-62453eb715fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:45.684332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76729186-f8d9-4e33-a39e-62453eb715fb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:45.711028 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 100/207] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:23:45 2021] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:23:48.271824 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73df73-4ef6-4c8b-9ec4-a0e0a4156608 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.272627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73df73-4ef6-4c8b-9ec4-a0e0a4156608 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.272627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73df73-4ef6-4c8b-9ec4-a0e0a4156608 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.274577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 108/208] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:48.281164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d891c6a-c3e7-437a-80a6-8d299dfa0edd None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.281743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d891c6a-c3e7-437a-80a6-8d299dfa0edd None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.281743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d891c6a-c3e7-437a-80a6-8d299dfa0edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.287725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3c9b4-802b-4ba0-91db-e5f34a525fe5 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.288047 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3c9b4-802b-4ba0-91db-e5f34a525fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.288322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3c9b4-802b-4ba0-91db-e5f34a525fe5 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.290103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 109/209] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:23:48.295866 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3d5c0-8e76-4cec-9feb-d5c09dc8a5a3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.296260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3d5c0-8e76-4cec-9feb-d5c09dc8a5a3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.296637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3d5c0-8e76-4cec-9feb-d5c09dc8a5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.301300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-7d891c6a-c3e7-437a-80a6-8d299dfa0edd None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:48.302448 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7d891c6a-c3e7-437a-80a6-8d299dfa0edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:48.314706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 101/210] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:48.315620 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-c8e3d5c0-8e76-4cec-9feb-d5c09dc8a5a3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:48.316817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c8e3d5c0-8e76-4cec-9feb-d5c09dc8a5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:48.324988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 110/211] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:48.335396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d891c6a-c3e7-437a-80a6-8d299dfa0edd None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.344824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d891c6a-c3e7-437a-80a6-8d299dfa0edd None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.348891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3d5c0-8e76-4cec-9feb-d5c09dc8a5a3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.349578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdf992-d2a7-4e38-a7e1-e75de52b630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.350455 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdf992-d2a7-4e38-a7e1-e75de52b630d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.350738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdf992-d2a7-4e38-a7e1-e75de52b630d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.351018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdf992-d2a7-4e38-a7e1-e75de52b630d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.357893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3d5c0-8e76-4cec-9feb-d5c09dc8a5a3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.362490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdf992-d2a7-4e38-a7e1-e75de52b630d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:48.362858 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda836c-c1df-4732-8e24-74c13fd1ee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.363653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda836c-c1df-4732-8e24-74c13fd1ee1b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.363934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda836c-c1df-4732-8e24-74c13fd1ee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.364209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda836c-c1df-4732-8e24-74c13fd1ee1b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.370281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-2bbdf992-d2a7-4e38-a7e1-e75de52b630d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:23:48.371489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 102/212] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:48.375337 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda836c-c1df-4732-8e24-74c13fd1ee1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:48.377921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdf992-d2a7-4e38-a7e1-e75de52b630d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.382929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-8fda836c-c1df-4732-8e24-74c13fd1ee1b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:23:48.384906 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 111/213] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:23:48.389217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdf992-d2a7-4e38-a7e1-e75de52b630d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.390472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda836c-c1df-4732-8e24-74c13fd1ee1b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.397415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff2559-81c1-4dd2-8f7f-d47a329d6467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.398121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff2559-81c1-4dd2-8f7f-d47a329d6467 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.398406 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff2559-81c1-4dd2-8f7f-d47a329d6467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.398705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff2559-81c1-4dd2-8f7f-d47a329d6467 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.399455 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff2559-81c1-4dd2-8f7f-d47a329d6467 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:48.399760 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff2559-81c1-4dd2-8f7f-d47a329d6467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.401274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda836c-c1df-4732-8e24-74c13fd1ee1b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.401381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff2559-81c1-4dd2-8f7f-d47a329d6467 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.406603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c712d8-5321-4249-83e2-bd7e306a3586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.407482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c712d8-5321-4249-83e2-bd7e306a3586 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.407952 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c712d8-5321-4249-83e2-bd7e306a3586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.408914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c712d8-5321-4249-83e2-bd7e306a3586 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.410172 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c712d8-5321-4249-83e2-bd7e306a3586 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:48.410668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c712d8-5321-4249-83e2-bd7e306a3586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.412429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c712d8-5321-4249-83e2-bd7e306a3586 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.415764 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 103/214] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:48.417200 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be568bae-9978-4fef-90b9-de8111fd018d None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.417482 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be568bae-9978-4fef-90b9-de8111fd018d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.417774 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be568bae-9978-4fef-90b9-de8111fd018d None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.419626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 104/215] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:48.420182 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be568bae-9978-4fef-90b9-de8111fd018d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.423194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 112/216] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:48.429849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4575-de72-4277-ba44-e42608b598d9 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.430130 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4575-de72-4277-ba44-e42608b598d9 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.430412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4575-de72-4277-ba44-e42608b598d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.436485 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be568bae-9978-4fef-90b9-de8111fd018d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.440936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1622-ddc9-4e81-9083-b79b2c6f88ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.442012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1622-ddc9-4e81-9083-b79b2c6f88ba admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.442461 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1622-ddc9-4e81-9083-b79b2c6f88ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.442734 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1622-ddc9-4e81-9083-b79b2c6f88ba admin admin] PATH_INFO: `/v3/users/e4516ff906e844739274b021ee36d50a` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.443943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed1622-ddc9-4e81-9083-b79b2c6f88ba admin admin] RBAC: Authorizing `identity:get_user(user_id=e4516ff906e844739274b021ee36d50a)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.446356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed1622-ddc9-4e81-9083-b79b2c6f88ba admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.448108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 105/217] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/users/e4516ff906e844739274b021ee36d50a => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:48.448209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-dfab4575-de72-4277-ba44-e42608b598d9 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:48.449219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-dfab4575-de72-4277-ba44-e42608b598d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:48.450014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1622-ddc9-4e81-9083-b79b2c6f88ba admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.458856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 113/218] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:48.459644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab4575-de72-4277-ba44-e42608b598d9 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.464814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1622-ddc9-4e81-9083-b79b2c6f88ba admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.468667 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab4575-de72-4277-ba44-e42608b598d9 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.471146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22731a71-1c4c-46b1-ac6b-78a8afc8b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.472009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731a71-1c4c-46b1-ac6b-78a8afc8b20a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.472292 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731a71-1c4c-46b1-ac6b-78a8afc8b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.472565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731a71-1c4c-46b1-ac6b-78a8afc8b20a admin admin] PATH_INFO: `/v3/users/e4516ff906e844739274b021ee36d50a` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.473215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef47d87-cd04-450c-8435-3a88268c3100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.473794 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22731a71-1c4c-46b1-ac6b-78a8afc8b20a admin admin] RBAC: Authorizing `identity:get_user(user_id=e4516ff906e844739274b021ee36d50a)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.474246 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47d87-cd04-450c-8435-3a88268c3100 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.474524 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47d87-cd04-450c-8435-3a88268c3100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.474794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47d87-cd04-450c-8435-3a88268c3100 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.476442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22731a71-1c4c-46b1-ac6b-78a8afc8b20a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.476601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef47d87-cd04-450c-8435-3a88268c3100 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.478195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 106/219] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/users/e4516ff906e844739274b021ee36d50a => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:48.479389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95caa9d-cbbc-4580-8575-8295cd7af72a None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.479675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95caa9d-cbbc-4580-8575-8295cd7af72a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.479954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95caa9d-cbbc-4580-8575-8295cd7af72a None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.481932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 107/220] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:48.482823 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95caa9d-cbbc-4580-8575-8295cd7af72a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.483327 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef47d87-cd04-450c-8435-3a88268c3100 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.485038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 114/221] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:48.487565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef47d87-cd04-450c-8435-3a88268c3100 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.496397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef47d87-cd04-450c-8435-3a88268c3100 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.497431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95caa9d-cbbc-4580-8575-8295cd7af72a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.500581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60351468-9ff3-413a-9fd9-21c8e2c4efb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.501408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351468-9ff3-413a-9fd9-21c8e2c4efb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.501595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50fd0-1a99-4b45-8d95-6869850e9292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.501693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351468-9ff3-413a-9fd9-21c8e2c4efb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.501975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351468-9ff3-413a-9fd9-21c8e2c4efb0 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.502406 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50fd0-1a99-4b45-8d95-6869850e9292 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.502688 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50fd0-1a99-4b45-8d95-6869850e9292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.502958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50fd0-1a99-4b45-8d95-6869850e9292 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.503128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351468-9ff3-413a-9fd9-21c8e2c4efb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.505115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351468-9ff3-413a-9fd9-21c8e2c4efb0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.506781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 115/222] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:48.507873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb7ab-093d-40eb-be3f-a2326a76147d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.508149 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb7ab-093d-40eb-be3f-a2326a76147d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.508416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb7ab-093d-40eb-be3f-a2326a76147d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.513734 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e50fd0-1a99-4b45-8d95-6869850e9292 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:48.520812 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-12e50fd0-1a99-4b45-8d95-6869850e9292 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:23:48.522070 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 108/223] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:48.523133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50fd0-1a99-4b45-8d95-6869850e9292 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.526339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-fe1eb7ab-093d-40eb-be3f-a2326a76147d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:48.527623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-fe1eb7ab-093d-40eb-be3f-a2326a76147d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:48.533383 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50fd0-1a99-4b45-8d95-6869850e9292 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.535831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 116/224] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:48.536595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eb7ab-093d-40eb-be3f-a2326a76147d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.540171 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadb9da-5c11-4e21-bbd4-d22cafff9cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.541206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadb9da-5c11-4e21-bbd4-d22cafff9cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.541492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadb9da-5c11-4e21-bbd4-d22cafff9cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.541856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadb9da-5c11-4e21-bbd4-d22cafff9cb4 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/users/e4516ff906e844739274b021ee36d50a/roles/78ec5da190bd41768cafe7cade4d3d69` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.544180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadb9da-5c11-4e21-bbd4-d22cafff9cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4effb777734052bf15ab6d7cf3d2d4, user_id=e4516ff906e844739274b021ee36d50a, role_id=78ec5da190bd41768cafe7cade4d3d69)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.546544 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eb7ab-093d-40eb-be3f-a2326a76147d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.546875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadb9da-5c11-4e21-bbd4-d22cafff9cb4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.551590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8959d-dad3-4ce3-ae90-a742abbf7317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.552640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8959d-dad3-4ce3-ae90-a742abbf7317 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.552884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8959d-dad3-4ce3-ae90-a742abbf7317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.553170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8959d-dad3-4ce3-ae90-a742abbf7317 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/users/e4516ff906e844739274b021ee36d50a/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.555910 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8959d-dad3-4ce3-ae90-a742abbf7317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4effb777734052bf15ab6d7cf3d2d4, user_id=e4516ff906e844739274b021ee36d50a, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.558833 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8959d-dad3-4ce3-ae90-a742abbf7317 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.561281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 109/225] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:23:48 2021] PUT /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/users/e4516ff906e844739274b021ee36d50a/roles/78ec5da190bd41768cafe7cade4d3d69 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:23:48.561951 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadb9da-5c11-4e21-bbd4-d22cafff9cb4 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.573975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 117/226] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:23:48 2021] PUT /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/users/e4516ff906e844739274b021ee36d50a/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:23:48.578873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8959d-dad3-4ce3-ae90-a742abbf7317 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.647649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadb9da-5c11-4e21-bbd4-d22cafff9cb4 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.670495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8959d-dad3-4ce3-ae90-a742abbf7317 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.676766 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b7093-6f12-48c5-a8d1-e1646f7008e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.678393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b7093-6f12-48c5-a8d1-e1646f7008e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.679552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b7093-6f12-48c5-a8d1-e1646f7008e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.679932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b7093-6f12-48c5-a8d1-e1646f7008e7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.681518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b7093-6f12-48c5-a8d1-e1646f7008e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.683758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b7093-6f12-48c5-a8d1-e1646f7008e7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.686642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 118/227] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:48.692968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b7093-6f12-48c5-a8d1-e1646f7008e7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.707161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b7093-6f12-48c5-a8d1-e1646f7008e7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.713878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434590c-9310-441e-b381-e539efb3bad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.715021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434590c-9310-441e-b381-e539efb3bad7 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.715403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434590c-9310-441e-b381-e539efb3bad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.715815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434590c-9310-441e-b381-e539efb3bad7 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.716956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434590c-9310-441e-b381-e539efb3bad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.718948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-b434590c-9310-441e-b381-e539efb3bad7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:48.718948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:23:48.718948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:23:48.720767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434590c-9310-441e-b381-e539efb3bad7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.724401 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32017c79-9257-43cd-ad18-ae218a9790dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.725958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32017c79-9257-43cd-ad18-ae218a9790dc admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.726645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32017c79-9257-43cd-ad18-ae218a9790dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.727165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32017c79-9257-43cd-ad18-ae218a9790dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.728306 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32017c79-9257-43cd-ad18-ae218a9790dc admin admin] RBAC: Adding query filter params (name=member) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:48.728851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32017c79-9257-43cd-ad18-ae218a9790dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.730987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32017c79-9257-43cd-ad18-ae218a9790dc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.743110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 110/228] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:48.749690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32017c79-9257-43cd-ad18-ae218a9790dc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.763968 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32017c79-9257-43cd-ad18-ae218a9790dc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.765666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 119/229] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:23:48 2021] POST /identity/v3/users => generated 297 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:23:48.769514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdff5a7-7594-4bd1-84bf-212759b656c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.770476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdff5a7-7594-4bd1-84bf-212759b656c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.770752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdff5a7-7594-4bd1-84bf-212759b656c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.771019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdff5a7-7594-4bd1-84bf-212759b656c5 admin admin] PATH_INFO: `/v3/users/54f5ab91b4794687aae8968a6afa1ad9` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.796537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdff5a7-7594-4bd1-84bf-212759b656c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=54f5ab91b4794687aae8968a6afa1ad9)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.799239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdff5a7-7594-4bd1-84bf-212759b656c5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.806240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 111/230] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/users/54f5ab91b4794687aae8968a6afa1ad9 => generated 297 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:48.809612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434590c-9310-441e-b381-e539efb3bad7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.820893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434590c-9310-441e-b381-e539efb3bad7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.825555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32137d-bd19-426b-96d9-6c53a2b176ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.826269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32137d-bd19-426b-96d9-6c53a2b176ed admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.826553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32137d-bd19-426b-96d9-6c53a2b176ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.826827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32137d-bd19-426b-96d9-6c53a2b176ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.836561 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32137d-bd19-426b-96d9-6c53a2b176ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.838466 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32137d-bd19-426b-96d9-6c53a2b176ed admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.848739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 120/231] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:23:48.855526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdff5a7-7594-4bd1-84bf-212759b656c5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.867294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdff5a7-7594-4bd1-84bf-212759b656c5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.873308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e8ee5-7b4a-4292-b1d1-160b20efc6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.874301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8ee5-7b4a-4292-b1d1-160b20efc6df admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.874580 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8ee5-7b4a-4292-b1d1-160b20efc6df admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.874853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8ee5-7b4a-4292-b1d1-160b20efc6df admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.876165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e8ee5-7b4a-4292-b1d1-160b20efc6df admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.878287 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e8ee5-7b4a-4292-b1d1-160b20efc6df admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.880284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 112/232] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:48.886859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32137d-bd19-426b-96d9-6c53a2b176ed admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:48.896284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32137d-bd19-426b-96d9-6c53a2b176ed admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:48.901619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4e878-22d8-473a-8405-cf7a9cae2c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:48.902344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e878-22d8-473a-8405-cf7a9cae2c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:48.902626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e878-22d8-473a-8405-cf7a9cae2c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:48.902905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e878-22d8-473a-8405-cf7a9cae2c3a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:48.903795 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4e878-22d8-473a-8405-cf7a9cae2c3a admin admin] RBAC: Adding query filter params (role.id=78401ee743b448d48b6c94ff8642907e, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4, user.id=54f5ab91b4794687aae8968a6afa1ad9) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:48.904110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4e878-22d8-473a-8405-cf7a9cae2c3a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:48.906038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4e878-22d8-473a-8405-cf7a9cae2c3a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:48.912685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 121/233] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:48 2021] GET /identity/v3/role_assignments?user.id=54f5ab91b4794687aae8968a6afa1ad9&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=78401ee743b448d48b6c94ff8642907e => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:51.575981 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c903f62-b51e-415b-aeaf-863152788314 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.576509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c903f62-b51e-415b-aeaf-863152788314 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.576509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c903f62-b51e-415b-aeaf-863152788314 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.578818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 113/234] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:51.585360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c285e-00da-45e9-b053-f617dd33d101 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.585877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c285e-00da-45e9-b053-f617dd33d101 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.585950 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c285e-00da-45e9-b053-f617dd33d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.615140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-204c285e-00da-45e9-b053-f617dd33d101 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:51.616982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-204c285e-00da-45e9-b053-f617dd33d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:51.639673 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 122/235] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:51.677426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c903f62-b51e-415b-aeaf-863152788314 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:51.690976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c903f62-b51e-415b-aeaf-863152788314 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:51.701465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a63b11-13eb-46c4-b366-778bf58ea2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:51.702649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63b11-13eb-46c4-b366-778bf58ea2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.703122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63b11-13eb-46c4-b366-778bf58ea2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.703582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63b11-13eb-46c4-b366-778bf58ea2c7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.718607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a63b11-13eb-46c4-b366-778bf58ea2c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:51.726836 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-e4a63b11-13eb-46c4-b366-778bf58ea2c7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:23:51.728408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 114/236] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:23:51 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:51.735238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c285e-00da-45e9-b053-f617dd33d101 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:51.756595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c285e-00da-45e9-b053-f617dd33d101 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:51.765257 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8bce1-a6e8-41f9-bc73-3943238e0dfd None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.765967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8bce1-a6e8-41f9-bc73-3943238e0dfd None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.766545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8bce1-a6e8-41f9-bc73-3943238e0dfd None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.767396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278150a6-57f9-4dbe-b1b6-77be6449f33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:51.768144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278150a6-57f9-4dbe-b1b6-77be6449f33c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.768427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278150a6-57f9-4dbe-b1b6-77be6449f33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.768705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278150a6-57f9-4dbe-b1b6-77be6449f33c admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.769464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 115/237] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:51 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:23:51.769564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278150a6-57f9-4dbe-b1b6-77be6449f33c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:51.770772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278150a6-57f9-4dbe-b1b6-77be6449f33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:51.771404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278150a6-57f9-4dbe-b1b6-77be6449f33c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:51.776149 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6bb8c-9b55-47b2-9162-6153ba657488 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.776681 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6bb8c-9b55-47b2-9162-6153ba657488 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.777161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6bb8c-9b55-47b2-9162-6153ba657488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.789655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 123/238] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:23:51 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:51.795694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278150a6-57f9-4dbe-b1b6-77be6449f33c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:51.798077 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e5d6bb8c-9b55-47b2-9162-6153ba657488 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:51.799501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e5d6bb8c-9b55-47b2-9162-6153ba657488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:51.809768 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278150a6-57f9-4dbe-b1b6-77be6449f33c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:51.814047 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 116/239] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:51.815731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c8082-0f85-4049-ba3f-92890e1a1065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:51.816081 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d1c3c-c34e-48fb-8dc0-afe0034446c0 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.816552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d1c3c-c34e-48fb-8dc0-afe0034446c0 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.816678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8082-0f85-4049-ba3f-92890e1a1065 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.816857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8082-0f85-4049-ba3f-92890e1a1065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.817129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8082-0f85-4049-ba3f-92890e1a1065 admin admin] PATH_INFO: `/v3/users/e4516ff906e844739274b021ee36d50a` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.817516 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d1c3c-c34e-48fb-8dc0-afe0034446c0 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.818413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c8082-0f85-4049-ba3f-92890e1a1065 admin admin] RBAC: Authorizing `identity:get_user(user_id=e4516ff906e844739274b021ee36d50a)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:51.819677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 117/240] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:51.824076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c8082-0f85-4049-ba3f-92890e1a1065 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:51.824076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 124/241] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:51 2021] GET /identity/v3/users/e4516ff906e844739274b021ee36d50a => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:51.825895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57017-ce95-4ac7-8302-2f7332ab813e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.826434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57017-ce95-4ac7-8302-2f7332ab813e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.826913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57017-ce95-4ac7-8302-2f7332ab813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.831480 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c8082-0f85-4049-ba3f-92890e1a1065 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:51.848071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c8082-0f85-4049-ba3f-92890e1a1065 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:51.850102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-02c57017-ce95-4ac7-8302-2f7332ab813e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:51.852700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-02c57017-ce95-4ac7-8302-2f7332ab813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:51.853227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fd471-ae7d-4ea4-b40b-29e035376717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:51.853931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fd471-ae7d-4ea4-b40b-29e035376717 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.854217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fd471-ae7d-4ea4-b40b-29e035376717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.854496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fd471-ae7d-4ea4-b40b-29e035376717 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.861477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 118/242] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:51.862432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c57017-ce95-4ac7-8302-2f7332ab813e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:51.863204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fd471-ae7d-4ea4-b40b-29e035376717 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:51.864975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fd471-ae7d-4ea4-b40b-29e035376717 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:51.874728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 125/243] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:23:51.875668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c57017-ce95-4ac7-8302-2f7332ab813e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:51.880631 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fd471-ae7d-4ea4-b40b-29e035376717 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:51.881779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087699-0da9-4ff0-a010-fcad29273ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:51.883011 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087699-0da9-4ff0-a010-fcad29273ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.883425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087699-0da9-4ff0-a010-fcad29273ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.883733 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087699-0da9-4ff0-a010-fcad29273ec8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.890188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fd471-ae7d-4ea4-b40b-29e035376717 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:51.894846 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3e789-e734-4285-a45d-1c524076c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:51.895717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e789-e734-4285-a45d-1c524076c2cc admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.895998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e789-e734-4285-a45d-1c524076c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.896279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e789-e734-4285-a45d-1c524076c2cc admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.897129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed087699-0da9-4ff0-a010-fcad29273ec8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:51.898045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3e789-e734-4285-a45d-1c524076c2cc admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:51.900083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3e789-e734-4285-a45d-1c524076c2cc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:51.902281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 126/244] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:51 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:51.905205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-ed087699-0da9-4ff0-a010-fcad29273ec8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:23:51.908758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3e789-e734-4285-a45d-1c524076c2cc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:51.909851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 119/245] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:23:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:51.910725 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087699-0da9-4ff0-a010-fcad29273ec8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:51.922342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087699-0da9-4ff0-a010-fcad29273ec8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:51.924174 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3e789-e734-4285-a45d-1c524076c2cc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:51.927072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195f612-7dfd-4467-9d11-f3666db96bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:51.927886 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195f612-7dfd-4467-9d11-f3666db96bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.928264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195f612-7dfd-4467-9d11-f3666db96bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.928582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195f612-7dfd-4467-9d11-f3666db96bfa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.929086 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec51a7-10c9-49df-bf75-2813991c9eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:51.929445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195f612-7dfd-4467-9d11-f3666db96bfa admin admin] RBAC: Adding query filter params (role.id=78ec5da190bd41768cafe7cade4d3d69, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4, user.id=e4516ff906e844739274b021ee36d50a) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:51.929775 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195f612-7dfd-4467-9d11-f3666db96bfa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:51.929931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec51a7-10c9-49df-bf75-2813991c9eca admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.930184 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec51a7-10c9-49df-bf75-2813991c9eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.930455 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec51a7-10c9-49df-bf75-2813991c9eca admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.931645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195f612-7dfd-4467-9d11-f3666db96bfa admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:51.940284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 120/246] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:51 2021] GET /identity/v3/role_assignments?user.id=e4516ff906e844739274b021ee36d50a&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=78ec5da190bd41768cafe7cade4d3d69 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:51.941090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195f612-7dfd-4467-9d11-f3666db96bfa admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:51.942828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec51a7-10c9-49df-bf75-2813991c9eca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:51.949976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-e2ec51a7-10c9-49df-bf75-2813991c9eca admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:23:51.951230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 127/247] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:51 2021] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:51.957706 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec51a7-10c9-49df-bf75-2813991c9eca admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:51.963621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195f612-7dfd-4467-9d11-f3666db96bfa admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:51.973830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94efaec-8bdb-4f1a-8f85-db70d1dba53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:51.973830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94efaec-8bdb-4f1a-8f85-db70d1dba53a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.973830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94efaec-8bdb-4f1a-8f85-db70d1dba53a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.973830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94efaec-8bdb-4f1a-8f85-db70d1dba53a admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.974425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94efaec-8bdb-4f1a-8f85-db70d1dba53a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:51.974425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94efaec-8bdb-4f1a-8f85-db70d1dba53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:51.974425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94efaec-8bdb-4f1a-8f85-db70d1dba53a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:51.984583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec51a7-10c9-49df-bf75-2813991c9eca admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:51.989656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eac5f-5c0d-467f-9a9f-e9ea59f6c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:51.990374 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eac5f-5c0d-467f-9a9f-e9ea59f6c793 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:51.990658 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eac5f-5c0d-467f-9a9f-e9ea59f6c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:51.990988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eac5f-5c0d-467f-9a9f-e9ea59f6c793 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:51.992254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eac5f-5c0d-467f-9a9f-e9ea59f6c793 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:51.992564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eac5f-5c0d-467f-9a9f-e9ea59f6c793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:51.994251 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eac5f-5c0d-467f-9a9f-e9ea59f6c793 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.000372 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 121/248] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:52.008601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 128/249] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:51 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:52.014536 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94efaec-8bdb-4f1a-8f85-db70d1dba53a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.022964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eac5f-5c0d-467f-9a9f-e9ea59f6c793 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.032877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94efaec-8bdb-4f1a-8f85-db70d1dba53a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.043018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f538-e6b5-4cc7-9414-e28d784cc16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.043998 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f538-e6b5-4cc7-9414-e28d784cc16a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.044282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f538-e6b5-4cc7-9414-e28d784cc16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.044559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f538-e6b5-4cc7-9414-e28d784cc16a admin admin] PATH_INFO: `/v3/users/e4516ff906e844739274b021ee36d50a` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.046204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eac5f-5c0d-467f-9a9f-e9ea59f6c793 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.047632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f538-e6b5-4cc7-9414-e28d784cc16a admin admin] RBAC: Authorizing `identity:get_user(user_id=e4516ff906e844739274b021ee36d50a)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.049876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f538-e6b5-4cc7-9414-e28d784cc16a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.052457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 122/250] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/users/e4516ff906e844739274b021ee36d50a => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:52.056664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fec11-e0e7-4cbf-9318-1eca8144275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.057623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fec11-e0e7-4cbf-9318-1eca8144275b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.058236 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fec11-e0e7-4cbf-9318-1eca8144275b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.058511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fec11-e0e7-4cbf-9318-1eca8144275b admin admin] PATH_INFO: `/v3/users/b35ec69164f543c7b30961ba421ed460` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.060971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f538-e6b5-4cc7-9414-e28d784cc16a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.081225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f538-e6b5-4cc7-9414-e28d784cc16a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.086807 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3d851-09cf-4cc5-89ff-7e5ebfed35e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.087526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d851-09cf-4cc5-89ff-7e5ebfed35e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.087809 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d851-09cf-4cc5-89ff-7e5ebfed35e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.088141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d851-09cf-4cc5-89ff-7e5ebfed35e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.094656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fec11-e0e7-4cbf-9318-1eca8144275b admin admin] RBAC: Authorizing `identity:get_user(user_id=b35ec69164f543c7b30961ba421ed460)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.096841 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fec11-e0e7-4cbf-9318-1eca8144275b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.098670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 129/251] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/users/b35ec69164f543c7b30961ba421ed460 => generated 297 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:52.098887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3d851-09cf-4cc5-89ff-7e5ebfed35e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.100789 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3d851-09cf-4cc5-89ff-7e5ebfed35e2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.112972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fec11-e0e7-4cbf-9318-1eca8144275b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.120134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 123/252] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:23:52.127960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fec11-e0e7-4cbf-9318-1eca8144275b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.136737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3d851-09cf-4cc5-89ff-7e5ebfed35e2 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.139180 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9434a1-594c-423a-bafb-4ea8b4fbc8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.139860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9434a1-594c-423a-bafb-4ea8b4fbc8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.140140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9434a1-594c-423a-bafb-4ea8b4fbc8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.140414 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9434a1-594c-423a-bafb-4ea8b4fbc8a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.149567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9434a1-594c-423a-bafb-4ea8b4fbc8a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.151991 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9434a1-594c-423a-bafb-4ea8b4fbc8a6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.157607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3d851-09cf-4cc5-89ff-7e5ebfed35e2 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.162338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 130/253] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:23:52.164943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa656da-5de4-44a2-95e5-96a9230e528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.165937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa656da-5de4-44a2-95e5-96a9230e528a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.166281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa656da-5de4-44a2-95e5-96a9230e528a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.166621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa656da-5de4-44a2-95e5-96a9230e528a admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.167966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa656da-5de4-44a2-95e5-96a9230e528a admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.170241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa656da-5de4-44a2-95e5-96a9230e528a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.171280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9434a1-594c-423a-bafb-4ea8b4fbc8a6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.172564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 124/254] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:52.179992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65839f-3894-44dc-b9a2-c580e7671803 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.179992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65839f-3894-44dc-b9a2-c580e7671803 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.179992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65839f-3894-44dc-b9a2-c580e7671803 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.182511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 125/255] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:52 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:52.183744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65839f-3894-44dc-b9a2-c580e7671803 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.184903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9434a1-594c-423a-bafb-4ea8b4fbc8a6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.190219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b87311-df76-4d19-8a95-8a2b7dfd993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.191323 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b87311-df76-4d19-8a95-8a2b7dfd993f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.191754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b87311-df76-4d19-8a95-8a2b7dfd993f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.192163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b87311-df76-4d19-8a95-8a2b7dfd993f admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.193639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b87311-df76-4d19-8a95-8a2b7dfd993f admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.195989 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b87311-df76-4d19-8a95-8a2b7dfd993f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.198236 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 131/256] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:52.205118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cf08d-b96b-4b91-879f-a3e3992361f9 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.205963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cf08d-b96b-4b91-879f-a3e3992361f9 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.206411 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cf08d-b96b-4b91-879f-a3e3992361f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.207175 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65839f-3894-44dc-b9a2-c580e7671803 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.213571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0a3f6-58f6-4182-994f-2a5e0d5dc74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.214452 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0a3f6-58f6-4182-994f-2a5e0d5dc74a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.215378 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0a3f6-58f6-4182-994f-2a5e0d5dc74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.215755 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0a3f6-58f6-4182-994f-2a5e0d5dc74a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.216768 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0a3f6-58f6-4182-994f-2a5e0d5dc74a admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4, user.id=e4516ff906e844739274b021ee36d50a) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:52.217144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0a3f6-58f6-4182-994f-2a5e0d5dc74a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.219157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0a3f6-58f6-4182-994f-2a5e0d5dc74a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.227655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 126/257] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/role_assignments?user.id=e4516ff906e844739274b021ee36d50a&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=a312b345efeb490eb4234d1ace386dec => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:52.228685 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0a3f6-58f6-4182-994f-2a5e0d5dc74a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.239148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-209cf08d-b96b-4b91-879f-a3e3992361f9 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:52.240424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-209cf08d-b96b-4b91-879f-a3e3992361f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:52.240735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0a3f6-58f6-4182-994f-2a5e0d5dc74a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.247633 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd145d6-c4c6-48f1-8f68-3d05d0db60d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.248473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd145d6-c4c6-48f1-8f68-3d05d0db60d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.248925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd145d6-c4c6-48f1-8f68-3d05d0db60d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.249374 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd145d6-c4c6-48f1-8f68-3d05d0db60d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.250619 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd145d6-c4c6-48f1-8f68-3d05d0db60d9 admin admin] RBAC: Adding query filter params (role.id=2d4c3613503847f2bb3bf938420dfc1e, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4, user.id=b35ec69164f543c7b30961ba421ed460) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:52.251099 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd145d6-c4c6-48f1-8f68-3d05d0db60d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.253442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd145d6-c4c6-48f1-8f68-3d05d0db60d9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.256512 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 132/258] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:52.258230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e22c2-390f-4f84-aa04-1286dccab61b None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.258230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e22c2-390f-4f84-aa04-1286dccab61b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.258471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e22c2-390f-4f84-aa04-1286dccab61b None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.260690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 133/259] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:52.265666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 127/260] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/role_assignments?user.id=b35ec69164f543c7b30961ba421ed460&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=2d4c3613503847f2bb3bf938420dfc1e => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:52.267886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388d90-fc90-41b6-9366-b5d7abeda0c1 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.268174 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388d90-fc90-41b6-9366-b5d7abeda0c1 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.268454 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388d90-fc90-41b6-9366-b5d7abeda0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.290885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd145d6-c4c6-48f1-8f68-3d05d0db60d9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.296305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5e388d90-fc90-41b6-9366-b5d7abeda0c1 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:52.297302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5e388d90-fc90-41b6-9366-b5d7abeda0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:52.311989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd145d6-c4c6-48f1-8f68-3d05d0db60d9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.315043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 134/261] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:52.318282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe0ab-a402-4ace-82be-dcf43af6f41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.319219 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe0ab-a402-4ace-82be-dcf43af6f41c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.319493 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe0ab-a402-4ace-82be-dcf43af6f41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.319862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe0ab-a402-4ace-82be-dcf43af6f41c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.321312 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fe0ab-a402-4ace-82be-dcf43af6f41c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.323253 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fe0ab-a402-4ace-82be-dcf43af6f41c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.325604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 128/262] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:52.333528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388d90-fc90-41b6-9366-b5d7abeda0c1 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.360708 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe0ab-a402-4ace-82be-dcf43af6f41c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.361902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388d90-fc90-41b6-9366-b5d7abeda0c1 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.367517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5180d33-a348-425e-8124-a98bac682e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.368235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180d33-a348-425e-8124-a98bac682e30 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.368577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180d33-a348-425e-8124-a98bac682e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.369015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180d33-a348-425e-8124-a98bac682e30 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.369891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5180d33-a348-425e-8124-a98bac682e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.372678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5180d33-a348-425e-8124-a98bac682e30 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.375920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe0ab-a402-4ace-82be-dcf43af6f41c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.380897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24704e0f-6464-4716-b33e-37a180f32140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.382659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24704e0f-6464-4716-b33e-37a180f32140 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.382945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24704e0f-6464-4716-b33e-37a180f32140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.385427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24704e0f-6464-4716-b33e-37a180f32140 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.406749 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24704e0f-6464-4716-b33e-37a180f32140 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:52.410056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 135/263] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:23:52 2021] POST /identity/v3/users => generated 293 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:23:52.416885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-24704e0f-6464-4716-b33e-37a180f32140 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:23:52.418569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 129/264] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:23:52.425828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5180d33-a348-425e-8124-a98bac682e30 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.438660 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5180d33-a348-425e-8124-a98bac682e30 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.444489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5841f-c2f1-4553-83a6-a4e8c3f2fa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.445805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5841f-c2f1-4553-83a6-a4e8c3f2fa08 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.446329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5841f-c2f1-4553-83a6-a4e8c3f2fa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.446751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5841f-c2f1-4553-83a6-a4e8c3f2fa08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.447790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5841f-c2f1-4553-83a6-a4e8c3f2fa08 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:52.448163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5841f-c2f1-4553-83a6-a4e8c3f2fa08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.450165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5841f-c2f1-4553-83a6-a4e8c3f2fa08 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.468765 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 136/265] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:52.470647 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24704e0f-6464-4716-b33e-37a180f32140 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.485500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24704e0f-6464-4716-b33e-37a180f32140 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.492107 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266ff41-ea1c-4900-af74-e946045587e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.493248 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266ff41-ea1c-4900-af74-e946045587e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.493530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266ff41-ea1c-4900-af74-e946045587e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.493895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266ff41-ea1c-4900-af74-e946045587e8 admin admin] PATH_INFO: `/v3/users/54f5ab91b4794687aae8968a6afa1ad9` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.495494 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266ff41-ea1c-4900-af74-e946045587e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=54f5ab91b4794687aae8968a6afa1ad9)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.498169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266ff41-ea1c-4900-af74-e946045587e8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.505859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 130/266] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/users/54f5ab91b4794687aae8968a6afa1ad9 => generated 297 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:52.507578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5841f-c2f1-4553-83a6-a4e8c3f2fa08 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.520822 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5841f-c2f1-4553-83a6-a4e8c3f2fa08 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.526432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c898a-7348-44d6-9eea-f86cc9eae677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.527555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c898a-7348-44d6-9eea-f86cc9eae677 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.527840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c898a-7348-44d6-9eea-f86cc9eae677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.528117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c898a-7348-44d6-9eea-f86cc9eae677 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.529630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c898a-7348-44d6-9eea-f86cc9eae677 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.531934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c898a-7348-44d6-9eea-f86cc9eae677 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.538523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 137/267] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:52 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:52.544518 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266ff41-ea1c-4900-af74-e946045587e8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:52.563797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266ff41-ea1c-4900-af74-e946045587e8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:52.575890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267b725-1faf-4390-adc9-d8abef07d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:52.577362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b725-1faf-4390-adc9-d8abef07d744 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:52.578251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b725-1faf-4390-adc9-d8abef07d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:52.578251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b725-1faf-4390-adc9-d8abef07d744 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/users/54f5ab91b4794687aae8968a6afa1ad9/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:52.580503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267b725-1faf-4390-adc9-d8abef07d744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4effb777734052bf15ab6d7cf3d2d4, user_id=54f5ab91b4794687aae8968a6afa1ad9, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:52.583321 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267b725-1faf-4390-adc9-d8abef07d744 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:52.602036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 131/268] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:23:52 2021] PUT /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/users/54f5ab91b4794687aae8968a6afa1ad9/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:23:54.864136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caa3a8-6b47-4f71-ad83-b90161f940ae None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:54.864639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caa3a8-6b47-4f71-ad83-b90161f940ae None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:54.864741 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caa3a8-6b47-4f71-ad83-b90161f940ae None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:54.866780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 138/269] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:54.872534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05154-c446-4592-9859-86d1a50311de None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:54.872928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05154-c446-4592-9859-86d1a50311de None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:54.873089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05154-c446-4592-9859-86d1a50311de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:54.890763 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-7db05154-c446-4592-9859-86d1a50311de None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:54.891936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7db05154-c446-4592-9859-86d1a50311de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:54.951057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 132/270] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:54.974756 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caa3a8-6b47-4f71-ad83-b90161f940ae None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:54.984165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0876c-0c61-458d-bc12-7a28713102cf None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:54.984522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0876c-0c61-458d-bc12-7a28713102cf None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:54.985104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0876c-0c61-458d-bc12-7a28713102cf None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:54.987229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 133/271] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:54 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:23:54.988876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caa3a8-6b47-4f71-ad83-b90161f940ae None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:54.993415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cffa1c-cc89-452d-9a7b-a2c935ee36a0 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:54.993699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cffa1c-cc89-452d-9a7b-a2c935ee36a0 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:54.993871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb42e9-b5f5-41ec-8480-45882c975142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:54.994002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cffa1c-cc89-452d-9a7b-a2c935ee36a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:54.994794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb42e9-b5f5-41ec-8480-45882c975142 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:54.995171 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb42e9-b5f5-41ec-8480-45882c975142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:54.995541 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb42e9-b5f5-41ec-8480-45882c975142 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.008542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb42e9-b5f5-41ec-8480-45882c975142 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:55.013583 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-49cffa1c-cc89-452d-9a7b-a2c935ee36a0 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:55.014798 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-49cffa1c-cc89-452d-9a7b-a2c935ee36a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:55.016129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-cccb42e9-b5f5-41ec-8480-45882c975142 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:23:55.017915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 139/272] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:54 2021] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:55.024254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb42e9-b5f5-41ec-8480-45882c975142 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.030511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 134/273] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:55.031708 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9074c3f-0803-4e72-a044-2059a51e21f7 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.031989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9074c3f-0803-4e72-a044-2059a51e21f7 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.032270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9074c3f-0803-4e72-a044-2059a51e21f7 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.033979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 135/274] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:55.039976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4acad5-0b06-46af-9219-9b967066ee39 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.040404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4acad5-0b06-46af-9219-9b967066ee39 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.040815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4acad5-0b06-46af-9219-9b967066ee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.041038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb42e9-b5f5-41ec-8480-45882c975142 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.046095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87dd09-2fdf-4a14-a8f8-b5fa219bad5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.046957 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87dd09-2fdf-4a14-a8f8-b5fa219bad5e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.047554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87dd09-2fdf-4a14-a8f8-b5fa219bad5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.047931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87dd09-2fdf-4a14-a8f8-b5fa219bad5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.049675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87dd09-2fdf-4a14-a8f8-b5fa219bad5e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:55.050106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87dd09-2fdf-4a14-a8f8-b5fa219bad5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.051821 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87dd09-2fdf-4a14-a8f8-b5fa219bad5e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.060020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-6e4acad5-0b06-46af-9219-9b967066ee39 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:55.061351 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-6e4acad5-0b06-46af-9219-9b967066ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:55.061458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 140/275] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:55.062313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87dd09-2fdf-4a14-a8f8-b5fa219bad5e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.077776 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 136/276] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:23:55.077776 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4acad5-0b06-46af-9219-9b967066ee39 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.077990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87dd09-2fdf-4a14-a8f8-b5fa219bad5e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.077990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af4d5e-0cde-4ea3-9ee3-e1692d53e9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.078152 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4d5e-0cde-4ea3-9ee3-e1692d53e9cf admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.078534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4d5e-0cde-4ea3-9ee3-e1692d53e9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.078891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4d5e-0cde-4ea3-9ee3-e1692d53e9cf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.082661 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4acad5-0b06-46af-9219-9b967066ee39 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.088329 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d85262-993e-4aff-80bc-83c4ccf97b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.089466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d85262-993e-4aff-80bc-83c4ccf97b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.089738 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af4d5e-0cde-4ea3-9ee3-e1692d53e9cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:55.089876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d85262-993e-4aff-80bc-83c4ccf97b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.090044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d85262-993e-4aff-80bc-83c4ccf97b95 admin admin] PATH_INFO: `/v3/users/b35ec69164f543c7b30961ba421ed460` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.091321 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d85262-993e-4aff-80bc-83c4ccf97b95 admin admin] RBAC: Authorizing `identity:get_user(user_id=b35ec69164f543c7b30961ba421ed460)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.093437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d85262-993e-4aff-80bc-83c4ccf97b95 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.095049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 137/277] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/users/b35ec69164f543c7b30961ba421ed460 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:55.097024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-b5af4d5e-0cde-4ea3-9ee3-e1692d53e9cf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:23:55.098565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 141/278] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:55.098956 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d85262-993e-4aff-80bc-83c4ccf97b95 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.104448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af4d5e-0cde-4ea3-9ee3-e1692d53e9cf admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.109572 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d85262-993e-4aff-80bc-83c4ccf97b95 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.113978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dd4b9-094f-4b93-83e1-19a1eb73db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.114759 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd4b9-094f-4b93-83e1-19a1eb73db7b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.115035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd4b9-094f-4b93-83e1-19a1eb73db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.115305 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd4b9-094f-4b93-83e1-19a1eb73db7b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.115474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af4d5e-0cde-4ea3-9ee3-e1692d53e9cf admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.117097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dd4b9-094f-4b93-83e1-19a1eb73db7b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.118804 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dd4b9-094f-4b93-83e1-19a1eb73db7b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.120277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465c9e1-aee9-4ff6-9f0d-978e948ff011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.125157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 138/279] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:55.125308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465c9e1-aee9-4ff6-9f0d-978e948ff011 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.125402 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dd4b9-094f-4b93-83e1-19a1eb73db7b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.125484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465c9e1-aee9-4ff6-9f0d-978e948ff011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.125484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465c9e1-aee9-4ff6-9f0d-978e948ff011 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.126606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465c9e1-aee9-4ff6-9f0d-978e948ff011 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.129375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465c9e1-aee9-4ff6-9f0d-978e948ff011 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.131427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 142/280] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:55.132670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465c9e1-aee9-4ff6-9f0d-978e948ff011 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.135984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dd4b9-094f-4b93-83e1-19a1eb73db7b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.140480 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd7535-38b1-4b52-9785-fba51a16c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.141150 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7535-38b1-4b52-9785-fba51a16c28d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.141458 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7535-38b1-4b52-9785-fba51a16c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.141701 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd7535-38b1-4b52-9785-fba51a16c28d admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.142312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465c9e1-aee9-4ff6-9f0d-978e948ff011 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.142491 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd7535-38b1-4b52-9785-fba51a16c28d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:55.142793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd7535-38b1-4b52-9785-fba51a16c28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.144395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd7535-38b1-4b52-9785-fba51a16c28d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.146682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd460447-7135-490a-add8-7d56c3204646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.147384 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460447-7135-490a-add8-7d56c3204646 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.147664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460447-7135-490a-add8-7d56c3204646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.147935 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460447-7135-490a-add8-7d56c3204646 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.148658 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd460447-7135-490a-add8-7d56c3204646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.150576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd460447-7135-490a-add8-7d56c3204646 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.152890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 139/281] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:55.152890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48a819-1ce8-4298-9b75-c628f0c2fdd8 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.152890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48a819-1ce8-4298-9b75-c628f0c2fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.152890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48a819-1ce8-4298-9b75-c628f0c2fdd8 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.152890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 140/282] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:55.152890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48a819-1ce8-4298-9b75-c628f0c2fdd8 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.170897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 143/283] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:23:55 2021] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:23:55.171692 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd460447-7135-490a-add8-7d56c3204646 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.171968 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48a819-1ce8-4298-9b75-c628f0c2fdd8 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.176586 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38472ac-0e68-45ca-bf23-eb45976a45cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.177672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38472ac-0e68-45ca-bf23-eb45976a45cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.177983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38472ac-0e68-45ca-bf23-eb45976a45cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.178262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38472ac-0e68-45ca-bf23-eb45976a45cb admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/users/b35ec69164f543c7b30961ba421ed460/roles/2d4c3613503847f2bb3bf938420dfc1e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.181424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38472ac-0e68-45ca-bf23-eb45976a45cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4effb777734052bf15ab6d7cf3d2d4, user_id=b35ec69164f543c7b30961ba421ed460, role_id=2d4c3613503847f2bb3bf938420dfc1e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.182347 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd460447-7135-490a-add8-7d56c3204646 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.184577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38472ac-0e68-45ca-bf23-eb45976a45cb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.187211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466589ad-cc53-4955-9dd0-c80c25012fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.188316 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466589ad-cc53-4955-9dd0-c80c25012fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.188316 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466589ad-cc53-4955-9dd0-c80c25012fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.188480 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466589ad-cc53-4955-9dd0-c80c25012fb0 admin admin] PATH_INFO: `/v3/users/d161c490bb7544e4b222c8f623aedeb0` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.210072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 141/284] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:23:55 2021] PUT /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/users/b35ec69164f543c7b30961ba421ed460/roles/2d4c3613503847f2bb3bf938420dfc1e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:23:55.210072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c796-87b5-47ae-abae-01f687c74103 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.210072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c796-87b5-47ae-abae-01f687c74103 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.210072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c796-87b5-47ae-abae-01f687c74103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.214627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466589ad-cc53-4955-9dd0-c80c25012fb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=d161c490bb7544e4b222c8f623aedeb0)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.218248 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466589ad-cc53-4955-9dd0-c80c25012fb0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.220796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-9b98c796-87b5-47ae-abae-01f687c74103 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:55.222061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9b98c796-87b5-47ae-abae-01f687c74103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:55.227412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 144/285] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/users/d161c490bb7544e4b222c8f623aedeb0 => generated 293 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:55.232490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466589ad-cc53-4955-9dd0-c80c25012fb0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.252460 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466589ad-cc53-4955-9dd0-c80c25012fb0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.306994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 142/286] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:55.332053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98c796-87b5-47ae-abae-01f687c74103 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.342353 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9882-44e7-4b21-b017-9fe0e40f56b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.343385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98c796-87b5-47ae-abae-01f687c74103 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.343724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9882-44e7-4b21-b017-9fe0e40f56b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.344335 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9882-44e7-4b21-b017-9fe0e40f56b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.344919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9882-44e7-4b21-b017-9fe0e40f56b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.346539 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f9882-44e7-4b21-b017-9fe0e40f56b0 admin admin] RBAC: Adding query filter params (role.id=78401ee743b448d48b6c94ff8642907e, user.id=d161c490bb7544e4b222c8f623aedeb0, scope.system=all) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:55.347167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f9882-44e7-4b21-b017-9fe0e40f56b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.349792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f9882-44e7-4b21-b017-9fe0e40f56b0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.349957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0e32-ee9c-4549-a26a-021b6d44a128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.351298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0e32-ee9c-4549-a26a-021b6d44a128 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.351611 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0e32-ee9c-4549-a26a-021b6d44a128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.351890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0e32-ee9c-4549-a26a-021b6d44a128 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.362509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 145/287] 10.222.0.83 () {56 vars in 1329 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/role_assignments?user.id=d161c490bb7544e4b222c8f623aedeb0&scope.system=all&role.id=78401ee743b448d48b6c94ff8642907e => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:55.367974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d0e32-ee9c-4549-a26a-021b6d44a128 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:55.375672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-a63d0e32-ee9c-4549-a26a-021b6d44a128 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:23:55.377723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 143/288] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:55.387007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9882-44e7-4b21-b017-9fe0e40f56b0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.398216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9882-44e7-4b21-b017-9fe0e40f56b0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.403416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d535f6a-05a3-4821-b3dd-a4b0378700d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.404457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d535f6a-05a3-4821-b3dd-a4b0378700d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.404923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d535f6a-05a3-4821-b3dd-a4b0378700d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.405375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d535f6a-05a3-4821-b3dd-a4b0378700d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.406499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d535f6a-05a3-4821-b3dd-a4b0378700d8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:55.407021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d535f6a-05a3-4821-b3dd-a4b0378700d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.409001 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d535f6a-05a3-4821-b3dd-a4b0378700d8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.420325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 146/289] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:55.426975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0e32-ee9c-4549-a26a-021b6d44a128 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.440199 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0e32-ee9c-4549-a26a-021b6d44a128 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.446049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fdd0f-f976-4bfb-9e21-d2ccfd579642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.447298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fdd0f-f976-4bfb-9e21-d2ccfd579642 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.447798 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fdd0f-f976-4bfb-9e21-d2ccfd579642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.448243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fdd0f-f976-4bfb-9e21-d2ccfd579642 admin admin] PATH_INFO: `/v3/users/54f5ab91b4794687aae8968a6afa1ad9` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.449880 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fdd0f-f976-4bfb-9e21-d2ccfd579642 admin admin] RBAC: Authorizing `identity:get_user(user_id=54f5ab91b4794687aae8968a6afa1ad9)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.452300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fdd0f-f976-4bfb-9e21-d2ccfd579642 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.454350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 144/290] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/users/54f5ab91b4794687aae8968a6afa1ad9 => generated 297 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:55.461888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d535f6a-05a3-4821-b3dd-a4b0378700d8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.474584 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d535f6a-05a3-4821-b3dd-a4b0378700d8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.481440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa003cbd-504c-44c2-b5ce-df1e3833fca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.482164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa003cbd-504c-44c2-b5ce-df1e3833fca9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.482449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa003cbd-504c-44c2-b5ce-df1e3833fca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.482726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa003cbd-504c-44c2-b5ce-df1e3833fca9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.492986 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa003cbd-504c-44c2-b5ce-df1e3833fca9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.494854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa003cbd-504c-44c2-b5ce-df1e3833fca9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.504976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 147/291] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:23:55.512028 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fdd0f-f976-4bfb-9e21-d2ccfd579642 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.522581 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fdd0f-f976-4bfb-9e21-d2ccfd579642 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.528214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5bb9e-0587-49aa-afd4-32d6d36b1add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.529366 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5bb9e-0587-49aa-afd4-32d6d36b1add admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.529819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5bb9e-0587-49aa-afd4-32d6d36b1add admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.530236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5bb9e-0587-49aa-afd4-32d6d36b1add admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.531701 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5bb9e-0587-49aa-afd4-32d6d36b1add admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.534078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5bb9e-0587-49aa-afd4-32d6d36b1add admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.536034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 145/292] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:55.543000 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa003cbd-504c-44c2-b5ce-df1e3833fca9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:55.552889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa003cbd-504c-44c2-b5ce-df1e3833fca9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:55.558970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc772ad-00aa-49e4-9d1e-9a82356e7fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:55.559955 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc772ad-00aa-49e4-9d1e-9a82356e7fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:55.560383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc772ad-00aa-49e4-9d1e-9a82356e7fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:55.560801 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc772ad-00aa-49e4-9d1e-9a82356e7fcf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:55.561953 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc772ad-00aa-49e4-9d1e-9a82356e7fcf admin admin] RBAC: Adding query filter params (role.id=78401ee743b448d48b6c94ff8642907e, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4, user.id=54f5ab91b4794687aae8968a6afa1ad9) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:55.562444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc772ad-00aa-49e4-9d1e-9a82356e7fcf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:55.564651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc772ad-00aa-49e4-9d1e-9a82356e7fcf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:55.572551 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 148/293] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:55 2021] GET /identity/v3/role_assignments?user.id=54f5ab91b4794687aae8968a6afa1ad9&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=78401ee743b448d48b6c94ff8642907e => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:57.694626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b980d-5744-4dd9-b416-05f2f247bdbc None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.695307 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b980d-5744-4dd9-b416-05f2f247bdbc None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.695470 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b980d-5744-4dd9-b416-05f2f247bdbc None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.697510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 146/294] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:57.703462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d0a8-b100-40d4-8445-4ed9bbebcf97 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.703860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d0a8-b100-40d4-8445-4ed9bbebcf97 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.704045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d0a8-b100-40d4-8445-4ed9bbebcf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.722131 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-6fd0d0a8-b100-40d4-8445-4ed9bbebcf97 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:57.723329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6fd0d0a8-b100-40d4-8445-4ed9bbebcf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:57.732168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 149/295] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:57.757465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b980d-5744-4dd9-b416-05f2f247bdbc None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:57.770269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b980d-5744-4dd9-b416-05f2f247bdbc None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:57.775143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd602170-6093-48eb-a757-fa0498462242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:57.775940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd602170-6093-48eb-a757-fa0498462242 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.776222 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd602170-6093-48eb-a757-fa0498462242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.776497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd602170-6093-48eb-a757-fa0498462242 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.787655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd602170-6093-48eb-a757-fa0498462242 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:57.795273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-bd602170-6093-48eb-a757-fa0498462242 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:23:57.798632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3359-7220-4c76-b782-8b393453ae3b None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.798913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3359-7220-4c76-b782-8b393453ae3b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.799189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3359-7220-4c76-b782-8b393453ae3b None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.801067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 150/297] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:57.801185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 147/297] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:57 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:57.803759 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3359-7220-4c76-b782-8b393453ae3b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:57.807327 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6386f46-9e84-4888-9997-865cbf1e8d5c None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.807613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6386f46-9e84-4888-9997-865cbf1e8d5c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.807885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6386f46-9e84-4888-9997-865cbf1e8d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.818061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3359-7220-4c76-b782-8b393453ae3b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:57.823481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df086a5-6290-4b98-bab1-4b6e29beb035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:57.824249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df086a5-6290-4b98-bab1-4b6e29beb035 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.824604 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df086a5-6290-4b98-bab1-4b6e29beb035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.825054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df086a5-6290-4b98-bab1-4b6e29beb035 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.825851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-a6386f46-9e84-4888-9997-865cbf1e8d5c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:57.826013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df086a5-6290-4b98-bab1-4b6e29beb035 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:57.826387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df086a5-6290-4b98-bab1-4b6e29beb035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:57.827036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a6386f46-9e84-4888-9997-865cbf1e8d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:57.828322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df086a5-6290-4b98-bab1-4b6e29beb035 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:57.838514 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 151/299] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:57 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:57.838700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 148/299] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:57.844495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df086a5-6290-4b98-bab1-4b6e29beb035 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:57.854865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df086a5-6290-4b98-bab1-4b6e29beb035 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:57.859082 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6386f46-9e84-4888-9997-865cbf1e8d5c None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:57.859488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153ea83-eeb8-49f4-ba38-205a7a5188e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:57.860351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153ea83-eeb8-49f4-ba38-205a7a5188e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.860632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153ea83-eeb8-49f4-ba38-205a7a5188e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.860909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153ea83-eeb8-49f4-ba38-205a7a5188e6 admin admin] PATH_INFO: `/v3/users/b35ec69164f543c7b30961ba421ed460` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.862168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153ea83-eeb8-49f4-ba38-205a7a5188e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=b35ec69164f543c7b30961ba421ed460)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:57.865102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153ea83-eeb8-49f4-ba38-205a7a5188e6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:57.867351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 152/300] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:57 2021] GET /identity/v3/users/b35ec69164f543c7b30961ba421ed460 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:57.868071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6386f46-9e84-4888-9997-865cbf1e8d5c None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:57.873205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153ea83-eeb8-49f4-ba38-205a7a5188e6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:57.874983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bbbe6-daae-4bc9-b477-b344efd1dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:57.875778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bbbe6-daae-4bc9-b477-b344efd1dede admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.876052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bbbe6-daae-4bc9-b477-b344efd1dede admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.876318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bbbe6-daae-4bc9-b477-b344efd1dede admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.884707 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153ea83-eeb8-49f4-ba38-205a7a5188e6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:57.887037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bbbe6-daae-4bc9-b477-b344efd1dede admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:57.889442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf5a46-4575-4cbe-930f-783e79d2eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:57.890112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf5a46-4575-4cbe-930f-783e79d2eae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.890485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf5a46-4575-4cbe-930f-783e79d2eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.890775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf5a46-4575-4cbe-930f-783e79d2eae3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.894015 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-796bbbe6-daae-4bc9-b477-b344efd1dede admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:23:57.899842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf5a46-4575-4cbe-930f-783e79d2eae3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:57.900866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 149/301] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:23:57.901605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf5a46-4575-4cbe-930f-783e79d2eae3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:57.902080 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bbbe6-daae-4bc9-b477-b344efd1dede admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:57.911432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bbbe6-daae-4bc9-b477-b344efd1dede admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:57.912276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 153/302] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:23:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:23:57.918778 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf5a46-4575-4cbe-930f-783e79d2eae3 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:57.920721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682bccb-a75e-43b8-b8e1-08fd4bd63479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:57.921391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682bccb-a75e-43b8-b8e1-08fd4bd63479 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.921719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682bccb-a75e-43b8-b8e1-08fd4bd63479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.921963 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682bccb-a75e-43b8-b8e1-08fd4bd63479 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.922731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682bccb-a75e-43b8-b8e1-08fd4bd63479 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:57.923031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682bccb-a75e-43b8-b8e1-08fd4bd63479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:57.924613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682bccb-a75e-43b8-b8e1-08fd4bd63479 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:57.928237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf5a46-4575-4cbe-930f-783e79d2eae3 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:57.933812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24393ad1-c493-4a1c-9d51-d5a322b04b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:57.934691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 150/303] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:57.934864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24393ad1-c493-4a1c-9d51-d5a322b04b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.935025 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24393ad1-c493-4a1c-9d51-d5a322b04b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.935187 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24393ad1-c493-4a1c-9d51-d5a322b04b70 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.935864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547bd1d-998b-4ff2-bdbb-5ae1857f1a99 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.936145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547bd1d-998b-4ff2-bdbb-5ae1857f1a99 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.936401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24393ad1-c493-4a1c-9d51-d5a322b04b70 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:57.936573 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547bd1d-998b-4ff2-bdbb-5ae1857f1a99 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.938397 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 151/304] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:57.938673 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24393ad1-c493-4a1c-9d51-d5a322b04b70 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:57.940553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 154/305] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:23:57 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:57.945958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24393ad1-c493-4a1c-9d51-d5a322b04b70 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:57.947170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684f27-2dfe-4ba3-b281-d0c17933764a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.947462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684f27-2dfe-4ba3-b281-d0c17933764a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.947727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684f27-2dfe-4ba3-b281-d0c17933764a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.957155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24393ad1-c493-4a1c-9d51-d5a322b04b70 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:57.962306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a88b-03b5-4d5d-9ea0-3d023176c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:57.963175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a88b-03b5-4d5d-9ea0-3d023176c690 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.963458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a88b-03b5-4d5d-9ea0-3d023176c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.963734 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a88b-03b5-4d5d-9ea0-3d023176c690 admin admin] PATH_INFO: `/v3/users/d161c490bb7544e4b222c8f623aedeb0` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.964931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035a88b-03b5-4d5d-9ea0-3d023176c690 admin admin] RBAC: Authorizing `identity:get_user(user_id=d161c490bb7544e4b222c8f623aedeb0)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:57.966056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d8684f27-2dfe-4ba3-b281-d0c17933764a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:57.967074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035a88b-03b5-4d5d-9ea0-3d023176c690 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:57.967221 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d8684f27-2dfe-4ba3-b281-d0c17933764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:57.968677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 155/306] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:57 2021] GET /identity/v3/users/d161c490bb7544e4b222c8f623aedeb0 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:57.969425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a88b-03b5-4d5d-9ea0-3d023176c690 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:57.979318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 152/307] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:57.980702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9f445-1bb3-46f4-a946-2432ad89c8c8 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.980983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9f445-1bb3-46f4-a946-2432ad89c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.981262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9f445-1bb3-46f4-a946-2432ad89c8c8 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.983094 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 153/308] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:23:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:57.984384 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a88b-03b5-4d5d-9ea0-3d023176c690 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:57.988075 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9f445-1bb3-46f4-a946-2432ad89c8c8 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:57.988881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfcb4a-a90c-4038-8857-8d492dbdcb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:57.989511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfcb4a-a90c-4038-8857-8d492dbdcb6c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:57.989855 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfcb4a-a90c-4038-8857-8d492dbdcb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:57.990176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfcb4a-a90c-4038-8857-8d492dbdcb6c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:57.990946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfcb4a-a90c-4038-8857-8d492dbdcb6c admin admin] RBAC: Adding query filter params (role.id=2d4c3613503847f2bb3bf938420dfc1e, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4, user.id=b35ec69164f543c7b30961ba421ed460) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:57.991301 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfcb4a-a90c-4038-8857-8d492dbdcb6c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:57.993102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfcb4a-a90c-4038-8857-8d492dbdcb6c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:58.009997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 156/309] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:23:57 2021] GET /identity/v3/role_assignments?user.id=b35ec69164f543c7b30961ba421ed460&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=2d4c3613503847f2bb3bf938420dfc1e => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:58.009997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e51a4-0a2f-4c6f-94c1-4beba5ecb7cf None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:58.009997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e51a4-0a2f-4c6f-94c1-4beba5ecb7cf None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:58.009997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e51a4-0a2f-4c6f-94c1-4beba5ecb7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:58.010763 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9f445-1bb3-46f4-a946-2432ad89c8c8 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:58.015388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867c5c-d911-454c-98c8-62c5ba7a3aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:58.016273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867c5c-d911-454c-98c8-62c5ba7a3aff admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:58.016547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867c5c-d911-454c-98c8-62c5ba7a3aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:58.016822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867c5c-d911-454c-98c8-62c5ba7a3aff admin admin] PATH_INFO: `/v3/system/users/d161c490bb7544e4b222c8f623aedeb0/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:58.018483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2867c5c-d911-454c-98c8-62c5ba7a3aff admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d161c490bb7544e4b222c8f623aedeb0, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:58.019548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-b2867c5c-d911-454c-98c8-62c5ba7a3aff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:58.019548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:23:58.019548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:23:58.020427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2867c5c-d911-454c-98c8-62c5ba7a3aff admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:58.028766 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-fa6e51a4-0a2f-4c6f-94c1-4beba5ecb7cf None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:58.030040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-fa6e51a4-0a2f-4c6f-94c1-4beba5ecb7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:58.032973 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 154/310] 10.222.0.83 () {58 vars in 1355 bytes} [Wed Dec 15 13:23:57 2021] PUT /identity/v3/system/users/d161c490bb7544e4b222c8f623aedeb0/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:23:58.039075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 157/311] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:23:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:23:58.039854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867c5c-d911-454c-98c8-62c5ba7a3aff admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:58.051600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867c5c-d911-454c-98c8-62c5ba7a3aff admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:58.057120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5f3a6-06dc-4c97-9c1d-4ccf69e13269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:58.058700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5f3a6-06dc-4c97-9c1d-4ccf69e13269 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:58.059220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5f3a6-06dc-4c97-9c1d-4ccf69e13269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:58.059746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5f3a6-06dc-4c97-9c1d-4ccf69e13269 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:58.063951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e51a4-0a2f-4c6f-94c1-4beba5ecb7cf None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:58.075074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e51a4-0a2f-4c6f-94c1-4beba5ecb7cf None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:58.078309 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5f3a6-06dc-4c97-9c1d-4ccf69e13269 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:23:58.080155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706000b2-e08c-46f2-8a47-41cb3753feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:58.081036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706000b2-e08c-46f2-8a47-41cb3753feb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:58.081325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706000b2-e08c-46f2-8a47-41cb3753feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:58.081604 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706000b2-e08c-46f2-8a47-41cb3753feb6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:58.082914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706000b2-e08c-46f2-8a47-41cb3753feb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:58.085226 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706000b2-e08c-46f2-8a47-41cb3753feb6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:58.087234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 158/312] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:23:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:58.089366 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-eaf5f3a6-06dc-4c97-9c1d-4ccf69e13269 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:23:58.091033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 155/313] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:23:58 2021] GET /identity/v3/roles/reader => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:23:58.098185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706000b2-e08c-46f2-8a47-41cb3753feb6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:58.099496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5f3a6-06dc-4c97-9c1d-4ccf69e13269 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:58.111746 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706000b2-e08c-46f2-8a47-41cb3753feb6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:58.114874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5f3a6-06dc-4c97-9c1d-4ccf69e13269 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:58.116693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eb1ea-b8cf-4436-b657-8470f66272f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:58.117386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eb1ea-b8cf-4436-b657-8470f66272f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:58.117701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eb1ea-b8cf-4436-b657-8470f66272f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:58.117994 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eb1ea-b8cf-4436-b657-8470f66272f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:58.118780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eb1ea-b8cf-4436-b657-8470f66272f7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:58.119092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eb1ea-b8cf-4436-b657-8470f66272f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:58.120729 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eb1ea-b8cf-4436-b657-8470f66272f7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:58.122111 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eb23e-64a7-49fb-bc5a-1ecf993d8ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:58.123331 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eb23e-64a7-49fb-bc5a-1ecf993d8ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:58.124250 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eb23e-64a7-49fb-bc5a-1ecf993d8ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:58.124731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eb23e-64a7-49fb-bc5a-1ecf993d8ab2 admin admin] PATH_INFO: `/v3/groups` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:58.125683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eb23e-64a7-49fb-bc5a-1ecf993d8ab2 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:58.127764 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-847eb23e-64a7-49fb-bc5a-1ecf993d8ab2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:23:58.127764 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:23:58.127764 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:23:58.129916 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eb23e-64a7-49fb-bc5a-1ecf993d8ab2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:58.136926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 159/314] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:23:58 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:23:58.138168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eb1ea-b8cf-4436-b657-8470f66272f7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:58.149658 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eb1ea-b8cf-4436-b657-8470f66272f7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:58.154861 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 156/315] 10.222.0.83 () {60 vars in 1155 bytes} [Wed Dec 15 13:23:58 2021] POST /identity/v3/groups => generated 229 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:23:58.162003 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbe646-caf6-4b8a-a1bc-0695c3b910bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:58.163778 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbe646-caf6-4b8a-a1bc-0695c3b910bd admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:58.164499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbe646-caf6-4b8a-a1bc-0695c3b910bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:58.164991 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbe646-caf6-4b8a-a1bc-0695c3b910bd admin admin] PATH_INFO: `/v3/users/87778d65319c405abb3da2886c7ee82f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:58.184322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbe646-caf6-4b8a-a1bc-0695c3b910bd admin admin] RBAC: Authorizing `identity:get_user(user_id=87778d65319c405abb3da2886c7ee82f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:58.187156 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbe646-caf6-4b8a-a1bc-0695c3b910bd admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:58.190262 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 160/316] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:23:58 2021] GET /identity/v3/users/87778d65319c405abb3da2886c7ee82f => generated 293 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:23:58.197396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eb23e-64a7-49fb-bc5a-1ecf993d8ab2 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:58.209506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eb23e-64a7-49fb-bc5a-1ecf993d8ab2 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:58.215762 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c8b80-0e39-450f-9fc9-33600bca2c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:58.216903 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8b80-0e39-450f-9fc9-33600bca2c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:58.217409 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8b80-0e39-450f-9fc9-33600bca2c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:58.217961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8b80-0e39-450f-9fc9-33600bca2c54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:58.219602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c8b80-0e39-450f-9fc9-33600bca2c54 admin admin] RBAC: Adding query filter params (role.id=2d4c3613503847f2bb3bf938420dfc1e, user.id=87778d65319c405abb3da2886c7ee82f, scope.system=all) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:23:58.220288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c8b80-0e39-450f-9fc9-33600bca2c54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:58.222926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c8b80-0e39-450f-9fc9-33600bca2c54 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:58.232566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 157/317] 10.222.0.83 () {56 vars in 1329 bytes} [Wed Dec 15 13:23:58 2021] GET /identity/v3/role_assignments?user.id=87778d65319c405abb3da2886c7ee82f&scope.system=all&role.id=2d4c3613503847f2bb3bf938420dfc1e => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:00.430034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f449344-c5f0-47ab-ba30-333ad18b512c None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.430551 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f449344-c5f0-47ab-ba30-333ad18b512c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.430625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f449344-c5f0-47ab-ba30-333ad18b512c None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.432637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 161/318] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:00.438853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71288b2-b094-4698-8b5c-f23e25a848e2 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.439269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71288b2-b094-4698-8b5c-f23e25a848e2 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.439438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71288b2-b094-4698-8b5c-f23e25a848e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.458130 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e71288b2-b094-4698-8b5c-f23e25a848e2 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:00.459306 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e71288b2-b094-4698-8b5c-f23e25a848e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:00.467835 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 158/319] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:00.491789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f449344-c5f0-47ab-ba30-333ad18b512c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:00.503808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f449344-c5f0-47ab-ba30-333ad18b512c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:00.507978 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e1367-bcec-448c-90fc-5a64cf6f3a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:00.508756 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e1367-bcec-448c-90fc-5a64cf6f3a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.509031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e1367-bcec-448c-90fc-5a64cf6f3a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.509300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e1367-bcec-448c-90fc-5a64cf6f3a68 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.519749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e1367-bcec-448c-90fc-5a64cf6f3a68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:00.526706 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-a85e1367-bcec-448c-90fc-5a64cf6f3a68 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:24:00.528040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 162/320] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:00.534560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71288b2-b094-4698-8b5c-f23e25a848e2 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:00.543940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71288b2-b094-4698-8b5c-f23e25a848e2 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:00.548348 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7192b7-04bd-478a-b058-1d418d872c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:00.549001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7192b7-04bd-478a-b058-1d418d872c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.549278 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7192b7-04bd-478a-b058-1d418d872c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.549548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7192b7-04bd-478a-b058-1d418d872c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.550324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7192b7-04bd-478a-b058-1d418d872c18 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:00.550624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7192b7-04bd-478a-b058-1d418d872c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:00.552213 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7192b7-04bd-478a-b058-1d418d872c18 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:00.561408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 159/321] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:24:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:00.567401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e1367-bcec-448c-90fc-5a64cf6f3a68 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:00.576809 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b25e8-bae3-43aa-86c6-ead50a5594ed None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.577080 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b25e8-bae3-43aa-86c6-ead50a5594ed None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.577351 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b25e8-bae3-43aa-86c6-ead50a5594ed None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.577468 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e1367-bcec-448c-90fc-5a64cf6f3a68 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:00.579250 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 160/322] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:00.582983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c35c4-f8a0-46e2-b8bd-d0718112005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:00.583854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c35c4-f8a0-46e2-b8bd-d0718112005a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.584136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c35c4-f8a0-46e2-b8bd-d0718112005a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.584414 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c35c4-f8a0-46e2-b8bd-d0718112005a admin admin] PATH_INFO: `/v3/users/d161c490bb7544e4b222c8f623aedeb0` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.585185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c63b9-dd4d-48c1-a419-fa5cb17ce823 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.585636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c35c4-f8a0-46e2-b8bd-d0718112005a admin admin] RBAC: Authorizing `identity:get_user(user_id=d161c490bb7544e4b222c8f623aedeb0)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:00.585869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c63b9-dd4d-48c1-a419-fa5cb17ce823 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.586324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c63b9-dd4d-48c1-a419-fa5cb17ce823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.587892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c35c4-f8a0-46e2-b8bd-d0718112005a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:00.589628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 163/323] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:24:00 2021] GET /identity/v3/users/d161c490bb7544e4b222c8f623aedeb0 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:00.594168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5ded-aa18-4142-9c77-e556d8c517aa None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.594463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5ded-aa18-4142-9c77-e556d8c517aa None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.594866 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5ded-aa18-4142-9c77-e556d8c517aa None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.596523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 164/324] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:00.597106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de5ded-aa18-4142-9c77-e556d8c517aa None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:00.608127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-824c63b9-dd4d-48c1-a419-fa5cb17ce823 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:00.609324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-824c63b9-dd4d-48c1-a419-fa5cb17ce823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:00.610026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de5ded-aa18-4142-9c77-e556d8c517aa None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:00.614195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44213465-37da-4904-a07b-f8103c69e012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:00.614811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44213465-37da-4904-a07b-f8103c69e012 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.615095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44213465-37da-4904-a07b-f8103c69e012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.615372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44213465-37da-4904-a07b-f8103c69e012 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.616850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44213465-37da-4904-a07b-f8103c69e012 admin admin] RBAC: Adding query filter params (role.id=78401ee743b448d48b6c94ff8642907e, user.id=d161c490bb7544e4b222c8f623aedeb0, scope.system=all) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:00.617161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44213465-37da-4904-a07b-f8103c69e012 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:00.617613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 161/325] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:00.618852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125b787-d847-41e7-ad2f-8e39fada3fac None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.619014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44213465-37da-4904-a07b-f8103c69e012 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:00.619164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125b787-d847-41e7-ad2f-8e39fada3fac None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.619404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125b787-d847-41e7-ad2f-8e39fada3fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.637268 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 165/326] 10.222.0.83 () {56 vars in 1329 bytes} [Wed Dec 15 13:24:00 2021] GET /identity/v3/role_assignments?user.id=d161c490bb7544e4b222c8f623aedeb0&scope.system=all&role.id=78401ee743b448d48b6c94ff8642907e => generated 510 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:00.637959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-a125b787-d847-41e7-ad2f-8e39fada3fac None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:00.639138 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a125b787-d847-41e7-ad2f-8e39fada3fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:00.641116 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44213465-37da-4904-a07b-f8103c69e012 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:00.648536 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 162/327] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:00.652871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44213465-37da-4904-a07b-f8103c69e012 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:00.660397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e779c-34f4-4471-ba3b-9cbf730e8e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:00.661219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e779c-34f4-4471-ba3b-9cbf730e8e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.661499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e779c-34f4-4471-ba3b-9cbf730e8e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.661797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e779c-34f4-4471-ba3b-9cbf730e8e22 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.663536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e779c-34f4-4471-ba3b-9cbf730e8e22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:00.665260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e779c-34f4-4471-ba3b-9cbf730e8e22 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:00.667158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 166/328] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:00.673133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125b787-d847-41e7-ad2f-8e39fada3fac None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:00.673343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e779c-34f4-4471-ba3b-9cbf730e8e22 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:00.683893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125b787-d847-41e7-ad2f-8e39fada3fac None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:00.684745 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e779c-34f4-4471-ba3b-9cbf730e8e22 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:00.688361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a47aba-bc4d-4715-8f4f-6889683fbf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:00.689029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a47aba-bc4d-4715-8f4f-6889683fbf8a admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.689220 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225103-16b2-49a7-ac5d-3b6841174b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:00.689335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a47aba-bc4d-4715-8f4f-6889683fbf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.689558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a47aba-bc4d-4715-8f4f-6889683fbf8a admin admin] PATH_INFO: `/v3/groups` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.690079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225103-16b2-49a7-ac5d-3b6841174b61 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.690316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a47aba-bc4d-4715-8f4f-6889683fbf8a admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:00.690408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225103-16b2-49a7-ac5d-3b6841174b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.690618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225103-16b2-49a7-ac5d-3b6841174b61 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.692261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a47aba-bc4d-4715-8f4f-6889683fbf8a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:00.704208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8225103-16b2-49a7-ac5d-3b6841174b61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:00.708278 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 163/329] 10.222.0.83 () {60 vars in 1155 bytes} [Wed Dec 15 13:24:00 2021] POST /identity/v3/groups => generated 226 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:00.711677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-c8225103-16b2-49a7-ac5d-3b6841174b61 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:24:00.713135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 167/330] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:00 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:00.719972 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a47aba-bc4d-4715-8f4f-6889683fbf8a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:00.731013 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a47aba-bc4d-4715-8f4f-6889683fbf8a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:00.736023 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71944ba1-aa52-4c85-afa9-edece09c1987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:00.736722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944ba1-aa52-4c85-afa9-edece09c1987 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.737005 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944ba1-aa52-4c85-afa9-edece09c1987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.737275 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944ba1-aa52-4c85-afa9-edece09c1987 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.738114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71944ba1-aa52-4c85-afa9-edece09c1987 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:00.738477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71944ba1-aa52-4c85-afa9-edece09c1987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:00.740192 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71944ba1-aa52-4c85-afa9-edece09c1987 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:00.750433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 164/331] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:24:00 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:00.756847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225103-16b2-49a7-ac5d-3b6841174b61 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:00.767526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225103-16b2-49a7-ac5d-3b6841174b61 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:00.772790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457629-786e-4406-9163-c2595a0db437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:00.773936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457629-786e-4406-9163-c2595a0db437 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.774293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457629-786e-4406-9163-c2595a0db437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.774638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457629-786e-4406-9163-c2595a0db437 admin admin] PATH_INFO: `/v3/users/87778d65319c405abb3da2886c7ee82f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.776192 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed457629-786e-4406-9163-c2595a0db437 admin admin] RBAC: Authorizing `identity:get_user(user_id=87778d65319c405abb3da2886c7ee82f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:00.778685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed457629-786e-4406-9163-c2595a0db437 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:00.780914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 168/332] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:24:00 2021] GET /identity/v3/users/87778d65319c405abb3da2886c7ee82f => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:00.787148 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71944ba1-aa52-4c85-afa9-edece09c1987 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:00.798999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71944ba1-aa52-4c85-afa9-edece09c1987 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:00.803682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5292550-d5fa-41ed-b668-b3876f21e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:00.804604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5292550-d5fa-41ed-b668-b3876f21e899 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:00.804884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5292550-d5fa-41ed-b668-b3876f21e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:00.805156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5292550-d5fa-41ed-b668-b3876f21e899 admin admin] PATH_INFO: `/v3/system/users/87778d65319c405abb3da2886c7ee82f/roles/2d4c3613503847f2bb3bf938420dfc1e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:00.806860 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5292550-d5fa-41ed-b668-b3876f21e899 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=87778d65319c405abb3da2886c7ee82f, role_id=2d4c3613503847f2bb3bf938420dfc1e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:00.808788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5292550-d5fa-41ed-b668-b3876f21e899 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:00.824456 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 165/333] 10.222.0.83 () {58 vars in 1355 bytes} [Wed Dec 15 13:24:00 2021] PUT /identity/v3/system/users/87778d65319c405abb3da2886c7ee82f/roles/2d4c3613503847f2bb3bf938420dfc1e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:03.682762 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453feec5-2c81-4a35-a502-929e1f3e7f09 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:03.683560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453feec5-2c81-4a35-a502-929e1f3e7f09 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:03.683560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453feec5-2c81-4a35-a502-929e1f3e7f09 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:03.685338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 169/334] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:03.691190 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35cdd-8ec1-4181-8f00-1dd35b1bd515 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:03.692010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35cdd-8ec1-4181-8f00-1dd35b1bd515 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:03.692476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35cdd-8ec1-4181-8f00-1dd35b1bd515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:03.716152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-35a35cdd-8ec1-4181-8f00-1dd35b1bd515 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:03.717794 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-35a35cdd-8ec1-4181-8f00-1dd35b1bd515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:03.729882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 166/335] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:03.770648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453feec5-2c81-4a35-a502-929e1f3e7f09 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:03.783228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453feec5-2c81-4a35-a502-929e1f3e7f09 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:03.787880 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94de4f-3e15-41b6-ad1e-be3e073b1f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:03.788918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94de4f-3e15-41b6-ad1e-be3e073b1f9f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:03.789390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94de4f-3e15-41b6-ad1e-be3e073b1f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:03.793931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94de4f-3e15-41b6-ad1e-be3e073b1f9f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:03.806234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94de4f-3e15-41b6-ad1e-be3e073b1f9f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:03.818335 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-4c94de4f-3e15-41b6-ad1e-be3e073b1f9f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:24:03.820783 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 170/336] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:03.826566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a35cdd-8ec1-4181-8f00-1dd35b1bd515 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:03.836652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a35cdd-8ec1-4181-8f00-1dd35b1bd515 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:03.841296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49c853-7e2c-4754-8868-45dc982df011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:03.846351 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49c853-7e2c-4754-8868-45dc982df011 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:03.846870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49c853-7e2c-4754-8868-45dc982df011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:03.847338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49c853-7e2c-4754-8868-45dc982df011 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:03.848314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49c853-7e2c-4754-8868-45dc982df011 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:03.848811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49c853-7e2c-4754-8868-45dc982df011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:03.850684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49c853-7e2c-4754-8868-45dc982df011 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:03.859775 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 167/337] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:03.865808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94de4f-3e15-41b6-ad1e-be3e073b1f9f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:03.876879 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94de4f-3e15-41b6-ad1e-be3e073b1f9f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:03.881456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9a744-d05f-4ff0-bb4a-a980ea0565f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:03.884690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9a744-d05f-4ff0-bb4a-a980ea0565f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:03.884690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9a744-d05f-4ff0-bb4a-a980ea0565f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:03.884690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9a744-d05f-4ff0-bb4a-a980ea0565f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:03.898221 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9a744-d05f-4ff0-bb4a-a980ea0565f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:03.900000 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9a744-d05f-4ff0-bb4a-a980ea0565f8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:03.916405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 171/338] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:03.922299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49c853-7e2c-4754-8868-45dc982df011 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:03.935025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49c853-7e2c-4754-8868-45dc982df011 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:03.944766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5f20-1b42-45f7-813f-16e2d62626d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:03.945971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5f20-1b42-45f7-813f-16e2d62626d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:03.946458 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5f20-1b42-45f7-813f-16e2d62626d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:03.946934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5f20-1b42-45f7-813f-16e2d62626d5 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:03.954607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f5f20-1b42-45f7-813f-16e2d62626d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:03.957009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f5f20-1b42-45f7-813f-16e2d62626d5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:03.959356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 168/339] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:03 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:03.965391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9a744-d05f-4ff0-bb4a-a980ea0565f8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:03.979442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9a744-d05f-4ff0-bb4a-a980ea0565f8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:03.989427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bf234-0bbc-44cd-bc62-5377fafdbbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:03.990315 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bf234-0bbc-44cd-bc62-5377fafdbbed admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:03.990601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bf234-0bbc-44cd-bc62-5377fafdbbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:03.990916 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bf234-0bbc-44cd-bc62-5377fafdbbed admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:03.999908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bf234-0bbc-44cd-bc62-5377fafdbbed admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:04.000937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-0e4bf234-0bbc-44cd-bc62-5377fafdbbed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:04.000937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:24:04.000937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:24:04.002164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bf234-0bbc-44cd-bc62-5377fafdbbed admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:04.003823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 172/340] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:03 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:04.010235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5f20-1b42-45f7-813f-16e2d62626d5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:04.020364 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5f20-1b42-45f7-813f-16e2d62626d5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:04.032925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec8cdf-a51e-4514-bbbd-d0088bd6fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:04.033919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec8cdf-a51e-4514-bbbd-d0088bd6fbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.034408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec8cdf-a51e-4514-bbbd-d0088bd6fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.034905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec8cdf-a51e-4514-bbbd-d0088bd6fbf0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.035948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec8cdf-a51e-4514-bbbd-d0088bd6fbf0 admin admin] RBAC: Adding query filter params (group.id=8e46d0baeed9487fa228167324924e80, role.id=78ec5da190bd41768cafe7cade4d3d69, scope.project.id=eb37d41816d74f66a5087e325e84211f) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:04.036458 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec8cdf-a51e-4514-bbbd-d0088bd6fbf0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:04.039169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec8cdf-a51e-4514-bbbd-d0088bd6fbf0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:04.045404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 169/341] 10.222.0.83 () {56 vars in 1397 bytes} [Wed Dec 15 13:24:04 2021] GET /identity/v3/role_assignments?group.id=8e46d0baeed9487fa228167324924e80&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=78ec5da190bd41768cafe7cade4d3d69 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:04.129305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d0df-044e-4829-add7-dd5433458f0e None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.129632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d0df-044e-4829-add7-dd5433458f0e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.129894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d0df-044e-4829-add7-dd5433458f0e None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.132371 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 173/342] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:04.138697 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb5a60-b1fa-49a0-a4ac-a46413b793a2 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.139297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb5a60-b1fa-49a0-a4ac-a46413b793a2 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.139819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb5a60-b1fa-49a0-a4ac-a46413b793a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.170907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f3eb5a60-b1fa-49a0-a4ac-a46413b793a2 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:04.172540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f3eb5a60-b1fa-49a0-a4ac-a46413b793a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:04.188207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 170/343] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:04.232110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d0df-044e-4829-add7-dd5433458f0e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:04.247474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d0df-044e-4829-add7-dd5433458f0e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:04.252766 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4ca52-2246-4253-9c22-1c3f88a00ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:04.253611 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4ca52-2246-4253-9c22-1c3f88a00ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.253913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4ca52-2246-4253-9c22-1c3f88a00ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.254192 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4ca52-2246-4253-9c22-1c3f88a00ac1 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.273393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4ca52-2246-4253-9c22-1c3f88a00ac1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:04.280474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-4cd4ca52-2246-4253-9c22-1c3f88a00ac1 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 13:24:04.281771 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 174/344] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:04 2021] GET /identity/v3/roles/reader => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:04.288827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb5a60-b1fa-49a0-a4ac-a46413b793a2 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:04.303149 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb5a60-b1fa-49a0-a4ac-a46413b793a2 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:04.313305 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343a154-3eb1-49db-acb8-56c7cc2f8f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:04.314012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343a154-3eb1-49db-acb8-56c7cc2f8f16 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.314293 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343a154-3eb1-49db-acb8-56c7cc2f8f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.314567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343a154-3eb1-49db-acb8-56c7cc2f8f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.315344 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343a154-3eb1-49db-acb8-56c7cc2f8f16 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:04.315647 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343a154-3eb1-49db-acb8-56c7cc2f8f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:04.317247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343a154-3eb1-49db-acb8-56c7cc2f8f16 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:04.329819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 171/345] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:24:04 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:04.336462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4ca52-2246-4253-9c22-1c3f88a00ac1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:04.349727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4ca52-2246-4253-9c22-1c3f88a00ac1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:04.362647 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed39db-5493-4a38-8152-a5b318da8cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:04.363565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed39db-5493-4a38-8152-a5b318da8cef admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.363852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed39db-5493-4a38-8152-a5b318da8cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.364130 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed39db-5493-4a38-8152-a5b318da8cef admin admin] PATH_INFO: `/v3/users/87778d65319c405abb3da2886c7ee82f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.366054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed39db-5493-4a38-8152-a5b318da8cef admin admin] RBAC: Authorizing `identity:get_user(user_id=87778d65319c405abb3da2886c7ee82f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:04.368805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed39db-5493-4a38-8152-a5b318da8cef admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:04.370914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 175/346] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:24:04 2021] GET /identity/v3/users/87778d65319c405abb3da2886c7ee82f => generated 293 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:04.377113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343a154-3eb1-49db-acb8-56c7cc2f8f16 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:04.387512 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db1220-3efd-4bb3-8d75-c1eddad9143e None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.387795 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db1220-3efd-4bb3-8d75-c1eddad9143e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.387949 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db1220-3efd-4bb3-8d75-c1eddad9143e None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.389654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 176/347] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:04.391230 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343a154-3eb1-49db-acb8-56c7cc2f8f16 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:04.398986 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd624d1a-9e12-4181-8015-3dacfbe8808c None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.399283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd624d1a-9e12-4181-8015-3dacfbe8808c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.399532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd624d1a-9e12-4181-8015-3dacfbe8808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.400509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37f97e-277b-4dad-a86d-22eab2aab7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:04.401157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37f97e-277b-4dad-a86d-22eab2aab7fc admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.401417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37f97e-277b-4dad-a86d-22eab2aab7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.401687 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37f97e-277b-4dad-a86d-22eab2aab7fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.402559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37f97e-277b-4dad-a86d-22eab2aab7fc admin admin] RBAC: Adding query filter params (role.id=2d4c3613503847f2bb3bf938420dfc1e, user.id=87778d65319c405abb3da2886c7ee82f, scope.system=all) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:04.402863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37f97e-277b-4dad-a86d-22eab2aab7fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:04.404719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37f97e-277b-4dad-a86d-22eab2aab7fc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:04.436882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 172/348] 10.222.0.83 () {56 vars in 1329 bytes} [Wed Dec 15 13:24:04 2021] GET /identity/v3/role_assignments?user.id=87778d65319c405abb3da2886c7ee82f&scope.system=all&role.id=2d4c3613503847f2bb3bf938420dfc1e => generated 510 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:04.439732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-dd624d1a-9e12-4181-8015-3dacfbe8808c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:04.440995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-dd624d1a-9e12-4181-8015-3dacfbe8808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:04.455189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 177/349] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:04.504120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37f97e-277b-4dad-a86d-22eab2aab7fc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:04.519528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37f97e-277b-4dad-a86d-22eab2aab7fc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:04.525709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806247c-c1f7-498e-98a3-6e598ae279a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:04.526559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806247c-c1f7-498e-98a3-6e598ae279a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.526840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806247c-c1f7-498e-98a3-6e598ae279a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.527114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806247c-c1f7-498e-98a3-6e598ae279a2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.545072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806247c-c1f7-498e-98a3-6e598ae279a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:04.556548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-1806247c-c1f7-498e-98a3-6e598ae279a2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:24:04.557850 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 173/350] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:04.564610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd624d1a-9e12-4181-8015-3dacfbe8808c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:04.574323 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd624d1a-9e12-4181-8015-3dacfbe8808c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:04.581817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f5ca7-254a-4345-be27-38060aa90258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:04.582505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f5ca7-254a-4345-be27-38060aa90258 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.582787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f5ca7-254a-4345-be27-38060aa90258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.583060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f5ca7-254a-4345-be27-38060aa90258 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.583838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f5ca7-254a-4345-be27-38060aa90258 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:04.584142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f5ca7-254a-4345-be27-38060aa90258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:04.586329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f5ca7-254a-4345-be27-38060aa90258 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:04.602894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 178/351] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:24:04 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:04.609104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806247c-c1f7-498e-98a3-6e598ae279a2 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:04.619349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806247c-c1f7-498e-98a3-6e598ae279a2 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:04.635639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74e555-37e5-447c-bf93-183a1e493383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:04.636314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74e555-37e5-447c-bf93-183a1e493383 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.636601 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74e555-37e5-447c-bf93-183a1e493383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.636879 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74e555-37e5-447c-bf93-183a1e493383 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.659168 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74e555-37e5-447c-bf93-183a1e493383 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:04.661014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74e555-37e5-447c-bf93-183a1e493383 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:04.676011 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 174/352] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:24:04.682163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f5ca7-254a-4345-be27-38060aa90258 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:04.695954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f5ca7-254a-4345-be27-38060aa90258 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:04.704242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb16a4-4424-42f7-baa0-decb732aad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:04.705119 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb16a4-4424-42f7-baa0-decb732aad99 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.705400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb16a4-4424-42f7-baa0-decb732aad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.705674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb16a4-4424-42f7-baa0-decb732aad99 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.706935 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb16a4-4424-42f7-baa0-decb732aad99 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:04.709552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb16a4-4424-42f7-baa0-decb732aad99 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:04.711797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 179/353] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:04 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:04.718021 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74e555-37e5-447c-bf93-183a1e493383 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:04.731323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74e555-37e5-447c-bf93-183a1e493383 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:04.739558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5d2b3-1f88-4453-b515-39cf4f76f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:04.740442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5d2b3-1f88-4453-b515-39cf4f76f026 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.740722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5d2b3-1f88-4453-b515-39cf4f76f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.741038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5d2b3-1f88-4453-b515-39cf4f76f026 admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.742354 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5d2b3-1f88-4453-b515-39cf4f76f026 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:04.743385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-f7d5d2b3-1f88-4453-b515-39cf4f76f026 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:04.743385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:24:04.743385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:24:04.744566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5d2b3-1f88-4453-b515-39cf4f76f026 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:04.746489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 175/354] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:04 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:04.752693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb16a4-4424-42f7-baa0-decb732aad99 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:04.767033 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb16a4-4424-42f7-baa0-decb732aad99 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:04.775826 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9122b94-529d-4ed4-afec-0d29abdcb772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:04.776497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122b94-529d-4ed4-afec-0d29abdcb772 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:04.776809 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122b94-529d-4ed4-afec-0d29abdcb772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:04.777055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122b94-529d-4ed4-afec-0d29abdcb772 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:04.777934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9122b94-529d-4ed4-afec-0d29abdcb772 admin admin] RBAC: Adding query filter params (group.id=8e46d0baeed9487fa228167324924e80, role.id=78401ee743b448d48b6c94ff8642907e, scope.project.id=eb37d41816d74f66a5087e325e84211f) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:04.778247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9122b94-529d-4ed4-afec-0d29abdcb772 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:04.780096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9122b94-529d-4ed4-afec-0d29abdcb772 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:04.791301 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 180/355] 10.222.0.83 () {56 vars in 1397 bytes} [Wed Dec 15 13:24:04 2021] GET /identity/v3/role_assignments?group.id=8e46d0baeed9487fa228167324924e80&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=78401ee743b448d48b6c94ff8642907e => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:05.218254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823106f-46a6-4a24-98ea-4071acb16237 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.218631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823106f-46a6-4a24-98ea-4071acb16237 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.218834 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823106f-46a6-4a24-98ea-4071acb16237 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.220811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 176/356] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:05.232712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf43d5-ca7c-4c45-8dc5-98e09e575cf8 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.233006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf43d5-ca7c-4c45-8dc5-98e09e575cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.233270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf43d5-ca7c-4c45-8dc5-98e09e575cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.251088 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d7d39-b676-408b-b3c8-36af11502594 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.251388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d7d39-b676-408b-b3c8-36af11502594 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.251632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d7d39-b676-408b-b3c8-36af11502594 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.253400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 177/357] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:05.261108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5caf43d5-ca7c-4c45-8dc5-98e09e575cf8 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:05.261343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040bb5-769e-4dad-a608-2c77d32883e5 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.261343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040bb5-769e-4dad-a608-2c77d32883e5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.261343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040bb5-769e-4dad-a608-2c77d32883e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.261815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5caf43d5-ca7c-4c45-8dc5-98e09e575cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:05.271434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 181/358] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:05.289352 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f3040bb5-769e-4dad-a608-2c77d32883e5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:05.290903 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f3040bb5-769e-4dad-a608-2c77d32883e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:05.301889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 178/359] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:05.305205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf43d5-ca7c-4c45-8dc5-98e09e575cf8 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.318833 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf43d5-ca7c-4c45-8dc5-98e09e575cf8 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.329546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c12bf0-206c-40d3-b406-b10ba7c43279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.330407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c12bf0-206c-40d3-b406-b10ba7c43279 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.330688 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c12bf0-206c-40d3-b406-b10ba7c43279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.330964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c12bf0-206c-40d3-b406-b10ba7c43279 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.335945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3040bb5-769e-4dad-a608-2c77d32883e5 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.350929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c12bf0-206c-40d3-b406-b10ba7c43279 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:05.351847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3040bb5-769e-4dad-a608-2c77d32883e5 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.359630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-86c12bf0-206c-40d3-b406-b10ba7c43279 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:24:05.359926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec2445-ec70-41b4-98a1-57eb7995a30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.360967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2445-ec70-41b4-98a1-57eb7995a30b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.361709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 182/360] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:05.362201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2445-ec70-41b4-98a1-57eb7995a30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.362684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2445-ec70-41b4-98a1-57eb7995a30b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.367469 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62162321-7c7e-41b4-932f-cba2b9e07271 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.367784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62162321-7c7e-41b4-932f-cba2b9e07271 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.368059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62162321-7c7e-41b4-932f-cba2b9e07271 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.370159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 183/361] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:05 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:05.370765 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62162321-7c7e-41b4-932f-cba2b9e07271 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.381189 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec2445-ec70-41b4-98a1-57eb7995a30b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:05.388129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62162321-7c7e-41b4-932f-cba2b9e07271 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.389522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-29ec2445-ec70-41b4-98a1-57eb7995a30b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:24:05.391160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 179/362] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:05.397926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10684227-4690-4530-a8ad-e3001fdde06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.397926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10684227-4690-4530-a8ad-e3001fdde06b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.397926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10684227-4690-4530-a8ad-e3001fdde06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.397926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10684227-4690-4530-a8ad-e3001fdde06b admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.398446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10684227-4690-4530-a8ad-e3001fdde06b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:05.398446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10684227-4690-4530-a8ad-e3001fdde06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.398650 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba67f-2dc6-41cc-aa32-d830bf1a2af6 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.398650 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba67f-2dc6-41cc-aa32-d830bf1a2af6 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.398650 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba67f-2dc6-41cc-aa32-d830bf1a2af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.398929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10684227-4690-4530-a8ad-e3001fdde06b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.415809 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 184/363] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:05.417118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10684227-4690-4530-a8ad-e3001fdde06b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.430292 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-401ba67f-2dc6-41cc-aa32-d830bf1a2af6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:05.431490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-401ba67f-2dc6-41cc-aa32-d830bf1a2af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:05.434105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10684227-4690-4530-a8ad-e3001fdde06b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.439702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfabeb-3920-4514-b0d9-a5ae97dec414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.440656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfabeb-3920-4514-b0d9-a5ae97dec414 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.441152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 180/364] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:05.441445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfabeb-3920-4514-b0d9-a5ae97dec414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.441941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfabeb-3920-4514-b0d9-a5ae97dec414 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.442043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ba67f-2dc6-41cc-aa32-d830bf1a2af6 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.443093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfabeb-3920-4514-b0d9-a5ae97dec414 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:05.443628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfabeb-3920-4514-b0d9-a5ae97dec414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.445569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfabeb-3920-4514-b0d9-a5ae97dec414 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.451715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ba67f-2dc6-41cc-aa32-d830bf1a2af6 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.455378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 185/365] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:05.460877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfe938-996c-42b4-9018-810dd45deeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.460877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfe938-996c-42b4-9018-810dd45deeea admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.460877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfe938-996c-42b4-9018-810dd45deeea admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.460877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfe938-996c-42b4-9018-810dd45deeea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.462696 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfabeb-3920-4514-b0d9-a5ae97dec414 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.468771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfe938-996c-42b4-9018-810dd45deeea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.470548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfe938-996c-42b4-9018-810dd45deeea admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.473431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfabeb-3920-4514-b0d9-a5ae97dec414 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.479394 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c382c74-e9bc-4460-99bf-a5a70e3c06b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.480343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c382c74-e9bc-4460-99bf-a5a70e3c06b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.480838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c382c74-e9bc-4460-99bf-a5a70e3c06b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.482676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c382c74-e9bc-4460-99bf-a5a70e3c06b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.486600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 181/366] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:05.487308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfe938-996c-42b4-9018-810dd45deeea admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.495253 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c382c74-e9bc-4460-99bf-a5a70e3c06b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.496515 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfe938-996c-42b4-9018-810dd45deeea admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.497586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c382c74-e9bc-4460-99bf-a5a70e3c06b0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.503661 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044dd25-58b9-446b-afae-c92f7586b217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.504369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044dd25-58b9-446b-afae-c92f7586b217 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.504649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044dd25-58b9-446b-afae-c92f7586b217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.504921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044dd25-58b9-446b-afae-c92f7586b217 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.513901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 186/367] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:24:05.514846 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c382c74-e9bc-4460-99bf-a5a70e3c06b0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.525688 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c382c74-e9bc-4460-99bf-a5a70e3c06b0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.534490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044dd25-58b9-446b-afae-c92f7586b217 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:05.540344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f069b1-bcea-4f9d-b412-28f3e557827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.541407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f069b1-bcea-4f9d-b412-28f3e557827a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.541903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f069b1-bcea-4f9d-b412-28f3e557827a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.542366 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f069b1-bcea-4f9d-b412-28f3e557827a admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.543335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-3044dd25-58b9-446b-afae-c92f7586b217 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:24:05.543980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f069b1-bcea-4f9d-b412-28f3e557827a admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.545095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 182/368] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:05.546112 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044dd25-58b9-446b-afae-c92f7586b217 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.547059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f069b1-bcea-4f9d-b412-28f3e557827a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.549349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 187/369] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:05.553238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f069b1-bcea-4f9d-b412-28f3e557827a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.560440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044dd25-58b9-446b-afae-c92f7586b217 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.565931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74971dc-bd5d-4aca-bd0e-97a2adf1d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.566208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f069b1-bcea-4f9d-b412-28f3e557827a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.567243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74971dc-bd5d-4aca-bd0e-97a2adf1d3fa admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.567788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74971dc-bd5d-4aca-bd0e-97a2adf1d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.568349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74971dc-bd5d-4aca-bd0e-97a2adf1d3fa admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.570143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74971dc-bd5d-4aca-bd0e-97a2adf1d3fa admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.571304 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d22d6-dbd0-4088-a8a0-a6a2a2a0abe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.572063 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d22d6-dbd0-4088-a8a0-a6a2a2a0abe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.572446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d22d6-dbd0-4088-a8a0-a6a2a2a0abe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.572823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d22d6-dbd0-4088-a8a0-a6a2a2a0abe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.573360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74971dc-bd5d-4aca-bd0e-97a2adf1d3fa admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.573810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d22d6-dbd0-4088-a8a0-a6a2a2a0abe6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:05.574374 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d22d6-dbd0-4088-a8a0-a6a2a2a0abe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.575722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 183/370] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:05.576619 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74971dc-bd5d-4aca-bd0e-97a2adf1d3fa admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.583609 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d22d6-dbd0-4088-a8a0-a6a2a2a0abe6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.589856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74971dc-bd5d-4aca-bd0e-97a2adf1d3fa admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.594124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 188/371] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:05.595037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008aa05-95ff-4fe5-8831-a3ff59ef7904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.595297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d22d6-dbd0-4088-a8a0-a6a2a2a0abe6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.596266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008aa05-95ff-4fe5-8831-a3ff59ef7904 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.596745 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008aa05-95ff-4fe5-8831-a3ff59ef7904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.597176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008aa05-95ff-4fe5-8831-a3ff59ef7904 admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.598669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008aa05-95ff-4fe5-8831-a3ff59ef7904 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.601476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008aa05-95ff-4fe5-8831-a3ff59ef7904 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.603339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 184/372] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:05.604236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008aa05-95ff-4fe5-8831-a3ff59ef7904 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.611683 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d22d6-dbd0-4088-a8a0-a6a2a2a0abe6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.615093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008aa05-95ff-4fe5-8831-a3ff59ef7904 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.616756 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a1b84-f36b-4889-b782-0364321770c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.617784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a1b84-f36b-4889-b782-0364321770c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.618218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a1b84-f36b-4889-b782-0364321770c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.618679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a1b84-f36b-4889-b782-0364321770c9 admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.620084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a1b84-f36b-4889-b782-0364321770c9 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.620833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9a962-4492-4671-a19e-d4dd7d801f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.621661 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9a962-4492-4671-a19e-d4dd7d801f70 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.622164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9a962-4492-4671-a19e-d4dd7d801f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.622428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a1b84-f36b-4889-b782-0364321770c9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.622780 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9a962-4492-4671-a19e-d4dd7d801f70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.624204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 189/373] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:05.625086 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a1b84-f36b-4889-b782-0364321770c9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.637775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a1b84-f36b-4889-b782-0364321770c9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.641045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9a962-4492-4671-a19e-d4dd7d801f70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.642545 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e490e-e2df-4121-8ad7-f64728205e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.643309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e490e-e2df-4121-8ad7-f64728205e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.643518 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9a962-4492-4671-a19e-d4dd7d801f70 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.643784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e490e-e2df-4121-8ad7-f64728205e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.644155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e490e-e2df-4121-8ad7-f64728205e33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.645097 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e490e-e2df-4121-8ad7-f64728205e33 admin admin] RBAC: Adding query filter params (group.id=8e46d0baeed9487fa228167324924e80, role.id=78ec5da190bd41768cafe7cade4d3d69, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:05.645506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e490e-e2df-4121-8ad7-f64728205e33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.648017 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e490e-e2df-4121-8ad7-f64728205e33 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.653998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 190/374] 10.222.0.83 () {56 vars in 1397 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/role_assignments?group.id=8e46d0baeed9487fa228167324924e80&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=78ec5da190bd41768cafe7cade4d3d69 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:05.655278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e490e-e2df-4121-8ad7-f64728205e33 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.661387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 185/375] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:05.665259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e490e-e2df-4121-8ad7-f64728205e33 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.667266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9a962-4492-4671-a19e-d4dd7d801f70 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.671351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ae587-d2bc-4c20-a57b-7f94f284e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.672107 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ae587-d2bc-4c20-a57b-7f94f284e054 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.672488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ae587-d2bc-4c20-a57b-7f94f284e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.672978 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ae587-d2bc-4c20-a57b-7f94f284e054 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.673824 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ae587-d2bc-4c20-a57b-7f94f284e054 admin admin] RBAC: Adding query filter params (group.id=8e46d0baeed9487fa228167324924e80, role.id=78401ee743b448d48b6c94ff8642907e, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:05.674278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ae587-d2bc-4c20-a57b-7f94f284e054 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.676613 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ae587-d2bc-4c20-a57b-7f94f284e054 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.679421 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9a962-4492-4671-a19e-d4dd7d801f70 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.685401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 191/376] 10.222.0.83 () {56 vars in 1397 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/role_assignments?group.id=8e46d0baeed9487fa228167324924e80&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=78401ee743b448d48b6c94ff8642907e => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:05.685633 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4d820-bb2b-4fcc-a2d0-180a0008b892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.686712 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d820-bb2b-4fcc-a2d0-180a0008b892 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.686997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d820-bb2b-4fcc-a2d0-180a0008b892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.687276 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d820-bb2b-4fcc-a2d0-180a0008b892 admin admin] PATH_INFO: `/v3/projects/0f70e030dc594b37825ba3900598d4c4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.693838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4d820-bb2b-4fcc-a2d0-180a0008b892 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f70e030dc594b37825ba3900598d4c4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.693838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4d820-bb2b-4fcc-a2d0-180a0008b892 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.696162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 186/377] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/projects/0f70e030dc594b37825ba3900598d4c4 => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:05.702032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ae587-d2bc-4c20-a57b-7f94f284e054 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.728274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ae587-d2bc-4c20-a57b-7f94f284e054 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.737098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d56dea-2124-425b-8446-c314d659cd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.738567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d56dea-2124-425b-8446-c314d659cd30 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.739008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d56dea-2124-425b-8446-c314d659cd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.739465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d56dea-2124-425b-8446-c314d659cd30 admin admin] PATH_INFO: `/v3/groups/b7f10f714f2d4255b841f6467b5c52ca` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.751473 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d56dea-2124-425b-8446-c314d659cd30 admin admin] RBAC: Authorizing `identity:get_group(group_id=b7f10f714f2d4255b841f6467b5c52ca)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.753778 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d56dea-2124-425b-8446-c314d659cd30 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.757526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 192/378] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/groups/b7f10f714f2d4255b841f6467b5c52ca => generated 229 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:05.762994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4d820-bb2b-4fcc-a2d0-180a0008b892 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:05.774683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4d820-bb2b-4fcc-a2d0-180a0008b892 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:05.782411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465b850-582c-449f-a733-12717852c058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:05.783298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b850-582c-449f-a733-12717852c058 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:05.783677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b850-582c-449f-a733-12717852c058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:05.784079 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b850-582c-449f-a733-12717852c058 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:05.785182 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465b850-582c-449f-a733-12717852c058 admin admin] RBAC: Adding query filter params (group.id=b7f10f714f2d4255b841f6467b5c52ca, role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=0f70e030dc594b37825ba3900598d4c4) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:05.785599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465b850-582c-449f-a733-12717852c058 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:05.787676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465b850-582c-449f-a733-12717852c058 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:05.796584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 187/379] 10.222.0.83 () {56 vars in 1397 bytes} [Wed Dec 15 13:24:05 2021] GET /identity/v3/role_assignments?group.id=b7f10f714f2d4255b841f6467b5c52ca&scope.project.id=0f70e030dc594b37825ba3900598d4c4&role.id=a312b345efeb490eb4234d1ace386dec => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:07.247133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe06ff6-14ab-4e49-a005-2955d82e3c54 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:07.248128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe06ff6-14ab-4e49-a005-2955d82e3c54 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:07.248620 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe06ff6-14ab-4e49-a005-2955d82e3c54 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:07.250948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 193/380] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:07.257028 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f0bd1-4581-4e06-a5e9-654f49cbc827 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:07.257424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f0bd1-4581-4e06-a5e9-654f49cbc827 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:07.257587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f0bd1-4581-4e06-a5e9-654f49cbc827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:07.290700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-122f0bd1-4581-4e06-a5e9-654f49cbc827 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:07.291938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-122f0bd1-4581-4e06-a5e9-654f49cbc827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:07.300177 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 188/381] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:07.324865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe06ff6-14ab-4e49-a005-2955d82e3c54 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:07.344865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe06ff6-14ab-4e49-a005-2955d82e3c54 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:07.349711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382ad6e-1f47-4aa3-9f53-2fe942157fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:07.350870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382ad6e-1f47-4aa3-9f53-2fe942157fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:07.351349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382ad6e-1f47-4aa3-9f53-2fe942157fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:07.351817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382ad6e-1f47-4aa3-9f53-2fe942157fe5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:07.369268 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382ad6e-1f47-4aa3-9f53-2fe942157fe5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:07.376883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-1382ad6e-1f47-4aa3-9f53-2fe942157fe5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:24:07.378742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 194/382] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:07.385330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f0bd1-4581-4e06-a5e9-654f49cbc827 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:07.394812 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f0bd1-4581-4e06-a5e9-654f49cbc827 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:07.405912 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccd643-c887-41f3-ab47-ac59b2bf90bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:07.406618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccd643-c887-41f3-ab47-ac59b2bf90bc admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:07.406897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccd643-c887-41f3-ab47-ac59b2bf90bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:07.407177 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccd643-c887-41f3-ab47-ac59b2bf90bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:07.407954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccd643-c887-41f3-ab47-ac59b2bf90bc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:07.408265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccd643-c887-41f3-ab47-ac59b2bf90bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:07.409904 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccd643-c887-41f3-ab47-ac59b2bf90bc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:07.423202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 189/383] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:07.429828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382ad6e-1f47-4aa3-9f53-2fe942157fe5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:07.444959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382ad6e-1f47-4aa3-9f53-2fe942157fe5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:07.452283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072acb7-42db-4acb-be90-4d34f43ca847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:07.453164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072acb7-42db-4acb-be90-4d34f43ca847 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:07.453442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072acb7-42db-4acb-be90-4d34f43ca847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:07.453718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072acb7-42db-4acb-be90-4d34f43ca847 admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:07.458571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072acb7-42db-4acb-be90-4d34f43ca847 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:07.461129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072acb7-42db-4acb-be90-4d34f43ca847 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:07.463055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 195/384] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:07 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:07.468750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccd643-c887-41f3-ab47-ac59b2bf90bc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:07.478835 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccd643-c887-41f3-ab47-ac59b2bf90bc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:07.489934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33108d0-98d5-4397-8784-809c827891f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:07.491377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33108d0-98d5-4397-8784-809c827891f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:07.491670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33108d0-98d5-4397-8784-809c827891f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:07.492009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33108d0-98d5-4397-8784-809c827891f6 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:07.494709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33108d0-98d5-4397-8784-809c827891f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:07.496825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33108d0-98d5-4397-8784-809c827891f6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:07.498740 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 190/385] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:07 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:07.504975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072acb7-42db-4acb-be90-4d34f43ca847 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:07.517284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072acb7-42db-4acb-be90-4d34f43ca847 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:07.526231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87cdd6-e9bf-4d48-a541-39cbc4bde5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:07.527708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87cdd6-e9bf-4d48-a541-39cbc4bde5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:07.527708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87cdd6-e9bf-4d48-a541-39cbc4bde5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:07.527708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87cdd6-e9bf-4d48-a541-39cbc4bde5c5 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f/groups/8e46d0baeed9487fa228167324924e80/roles/78ec5da190bd41768cafe7cade4d3d69` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:07.536010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87cdd6-e9bf-4d48-a541-39cbc4bde5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb37d41816d74f66a5087e325e84211f, group_id=8e46d0baeed9487fa228167324924e80, role_id=78ec5da190bd41768cafe7cade4d3d69)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:07.538740 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87cdd6-e9bf-4d48-a541-39cbc4bde5c5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:07.571499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 196/386] 10.222.0.83 () {58 vars in 1463 bytes} [Wed Dec 15 13:24:07 2021] PUT /identity/v3/projects/eb37d41816d74f66a5087e325e84211f/groups/8e46d0baeed9487fa228167324924e80/roles/78ec5da190bd41768cafe7cade4d3d69 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:07.903036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d67db-810a-47be-82b2-e734f0549e98 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:07.903593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d67db-810a-47be-82b2-e734f0549e98 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:07.904013 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d67db-810a-47be-82b2-e734f0549e98 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:07.906216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 191/387] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:07.913652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99cfc7-5cee-4492-8154-38184a1f4b32 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:07.914164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99cfc7-5cee-4492-8154-38184a1f4b32 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:07.914589 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99cfc7-5cee-4492-8154-38184a1f4b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:07.933986 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-4d99cfc7-5cee-4492-8154-38184a1f4b32 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:07.935400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4d99cfc7-5cee-4492-8154-38184a1f4b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:08.000291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 197/388] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:08.035106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d67db-810a-47be-82b2-e734f0549e98 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:08.054560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d67db-810a-47be-82b2-e734f0549e98 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:08.059612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f43afe-09a1-4204-9d56-f29388d75052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:08.060571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f43afe-09a1-4204-9d56-f29388d75052 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:08.061000 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f43afe-09a1-4204-9d56-f29388d75052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:08.061438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f43afe-09a1-4204-9d56-f29388d75052 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:08.079029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f43afe-09a1-4204-9d56-f29388d75052 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:08.086218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-e5f43afe-09a1-4204-9d56-f29388d75052 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:24:08.087853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 192/389] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:08.094112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99cfc7-5cee-4492-8154-38184a1f4b32 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:08.103944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99cfc7-5cee-4492-8154-38184a1f4b32 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:08.113004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf655926-5189-4eb6-8e63-4933a1394a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:08.113889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf655926-5189-4eb6-8e63-4933a1394a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:08.114333 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf655926-5189-4eb6-8e63-4933a1394a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:08.114758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf655926-5189-4eb6-8e63-4933a1394a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:08.115679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf655926-5189-4eb6-8e63-4933a1394a7a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:08.116681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf655926-5189-4eb6-8e63-4933a1394a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:08.118435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf655926-5189-4eb6-8e63-4933a1394a7a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:08.127481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 198/390] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:24:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:08.134144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f43afe-09a1-4204-9d56-f29388d75052 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:08.144848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f43afe-09a1-4204-9d56-f29388d75052 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:08.153711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d61af-23cc-4260-be71-c282182ff17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:08.154802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d61af-23cc-4260-be71-c282182ff17c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:08.155226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d61af-23cc-4260-be71-c282182ff17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:08.155642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d61af-23cc-4260-be71-c282182ff17c admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:08.157041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d61af-23cc-4260-be71-c282182ff17c admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:08.159119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d61af-23cc-4260-be71-c282182ff17c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:08.160879 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 193/391] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:08 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:08.167525 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf655926-5189-4eb6-8e63-4933a1394a7a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:08.177691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf655926-5189-4eb6-8e63-4933a1394a7a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:08.186076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f4b86-d068-43ea-973b-21bcd07c3a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:08.187105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f4b86-d068-43ea-973b-21bcd07c3a38 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:08.187536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f4b86-d068-43ea-973b-21bcd07c3a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:08.187961 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f4b86-d068-43ea-973b-21bcd07c3a38 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:08.189315 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f4b86-d068-43ea-973b-21bcd07c3a38 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:08.191632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f4b86-d068-43ea-973b-21bcd07c3a38 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:08.193744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 199/392] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:08 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:08.199967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d61af-23cc-4260-be71-c282182ff17c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:08.210229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d61af-23cc-4260-be71-c282182ff17c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:08.220215 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5633a4-5372-4e65-b3cd-af80d5e3f8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:08.221313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5633a4-5372-4e65-b3cd-af80d5e3f8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:08.221740 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5633a4-5372-4e65-b3cd-af80d5e3f8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:08.222181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5633a4-5372-4e65-b3cd-af80d5e3f8dd admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f/groups/8e46d0baeed9487fa228167324924e80/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:08.227111 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5633a4-5372-4e65-b3cd-af80d5e3f8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb37d41816d74f66a5087e325e84211f, group_id=8e46d0baeed9487fa228167324924e80, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:08.230163 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5633a4-5372-4e65-b3cd-af80d5e3f8dd admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:08.268336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 194/393] 10.222.0.83 () {58 vars in 1463 bytes} [Wed Dec 15 13:24:08 2021] PUT /identity/v3/projects/eb37d41816d74f66a5087e325e84211f/groups/8e46d0baeed9487fa228167324924e80/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:08.793390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05309c-812c-4cc4-a034-40716d756018 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:08.793964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05309c-812c-4cc4-a034-40716d756018 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:08.793964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05309c-812c-4cc4-a034-40716d756018 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:08.796005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 200/394] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:08.802497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce1751-71c3-4e4f-8419-d8c5c5088d9a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:08.802818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce1751-71c3-4e4f-8419-d8c5c5088d9a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:08.803158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce1751-71c3-4e4f-8419-d8c5c5088d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:08.825142 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-2dce1751-71c3-4e4f-8419-d8c5c5088d9a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:08.826343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2dce1751-71c3-4e4f-8419-d8c5c5088d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:08.898367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 195/395] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:08.938195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05309c-812c-4cc4-a034-40716d756018 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:08.955712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05309c-812c-4cc4-a034-40716d756018 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:08.963528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c219c-b4dc-4d69-b20e-81a74a53997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:08.964351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c219c-b4dc-4d69-b20e-81a74a53997d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:08.964630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c219c-b4dc-4d69-b20e-81a74a53997d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:08.964902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c219c-b4dc-4d69-b20e-81a74a53997d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:08.978662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c219c-b4dc-4d69-b20e-81a74a53997d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:08.986101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-d97c219c-b4dc-4d69-b20e-81a74a53997d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:24:08.987497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 201/396] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:08.994071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce1751-71c3-4e4f-8419-d8c5c5088d9a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.003691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce1751-71c3-4e4f-8419-d8c5c5088d9a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.011647 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a48950-9eca-46ed-abbb-3aecd053d90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.012327 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a48950-9eca-46ed-abbb-3aecd053d90d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.012607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a48950-9eca-46ed-abbb-3aecd053d90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.012881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a48950-9eca-46ed-abbb-3aecd053d90d admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.013643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a48950-9eca-46ed-abbb-3aecd053d90d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:09.013971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a48950-9eca-46ed-abbb-3aecd053d90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.015681 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a48950-9eca-46ed-abbb-3aecd053d90d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.028876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 196/397] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:09.032899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d093-5d25-4c91-832c-e278cf174d87 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.033189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d093-5d25-4c91-832c-e278cf174d87 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.033476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d093-5d25-4c91-832c-e278cf174d87 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.035513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 202/398] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:09.036484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a48950-9eca-46ed-abbb-3aecd053d90d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.041090 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28faea-57e7-4453-b294-81b508987fc3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.041377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28faea-57e7-4453-b294-81b508987fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.041653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28faea-57e7-4453-b294-81b508987fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.065316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a48950-9eca-46ed-abbb-3aecd053d90d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.072483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-ab28faea-57e7-4453-b294-81b508987fc3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:09.073673 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ab28faea-57e7-4453-b294-81b508987fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:09.080505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43717c-6078-40f8-bf10-816c8cdb8a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.081425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43717c-6078-40f8-bf10-816c8cdb8a0c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.081706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43717c-6078-40f8-bf10-816c8cdb8a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.082003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43717c-6078-40f8-bf10-816c8cdb8a0c admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.083939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43717c-6078-40f8-bf10-816c8cdb8a0c admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.089882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43717c-6078-40f8-bf10-816c8cdb8a0c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.092025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 197/399] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:09 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:09.094268 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 203/400] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:09.102825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43717c-6078-40f8-bf10-816c8cdb8a0c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.113321 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43717c-6078-40f8-bf10-816c8cdb8a0c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.125325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbc9a7-85e1-4bba-8c25-ed64abdd2f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.125325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbc9a7-85e1-4bba-8c25-ed64abdd2f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.125594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28faea-57e7-4453-b294-81b508987fc3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.125685 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbc9a7-85e1-4bba-8c25-ed64abdd2f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.125685 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbc9a7-85e1-4bba-8c25-ed64abdd2f69 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.125685 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbc9a7-85e1-4bba-8c25-ed64abdd2f69 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.125907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbc9a7-85e1-4bba-8c25-ed64abdd2f69 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.128022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 198/401] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:09 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:09.132140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28faea-57e7-4453-b294-81b508987fc3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.140597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbc9a7-85e1-4bba-8c25-ed64abdd2f69 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.143625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46e88b-0790-4184-bdda-1b2e0da7da97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.144691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46e88b-0790-4184-bdda-1b2e0da7da97 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.145211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46e88b-0790-4184-bdda-1b2e0da7da97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.145694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46e88b-0790-4184-bdda-1b2e0da7da97 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.158396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbc9a7-85e1-4bba-8c25-ed64abdd2f69 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.167628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46e88b-0790-4184-bdda-1b2e0da7da97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:09.173597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c77230-1a76-4e93-b7b8-17a7bf265f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.174849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c77230-1a76-4e93-b7b8-17a7bf265f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.175342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c77230-1a76-4e93-b7b8-17a7bf265f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.175826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c77230-1a76-4e93-b7b8-17a7bf265f68 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/groups/8e46d0baeed9487fa228167324924e80/roles/78ec5da190bd41768cafe7cade4d3d69` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.181295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-6a46e88b-0790-4184-bdda-1b2e0da7da97 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:24:09.182797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c77230-1a76-4e93-b7b8-17a7bf265f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4effb777734052bf15ab6d7cf3d2d4, group_id=8e46d0baeed9487fa228167324924e80, role_id=78ec5da190bd41768cafe7cade4d3d69)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.185955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c77230-1a76-4e93-b7b8-17a7bf265f68 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.192007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 204/402] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:09.196918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46e88b-0790-4184-bdda-1b2e0da7da97 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.211180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 199/403] 10.222.0.83 () {58 vars in 1463 bytes} [Wed Dec 15 13:24:09 2021] PUT /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/groups/8e46d0baeed9487fa228167324924e80/roles/78ec5da190bd41768cafe7cade4d3d69 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:09.219120 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46e88b-0790-4184-bdda-1b2e0da7da97 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.255991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe8393-99fb-4211-9a88-a825a9021387 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.257181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe8393-99fb-4211-9a88-a825a9021387 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.257962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe8393-99fb-4211-9a88-a825a9021387 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.261041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 200/404] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:09.278035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0867-6aa1-45a8-8d69-8e87af4da92c None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.279635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0867-6aa1-45a8-8d69-8e87af4da92c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.279635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0867-6aa1-45a8-8d69-8e87af4da92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.307224 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc319ab-ed71-4d50-9888-639358302b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.307905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc319ab-ed71-4d50-9888-639358302b7d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.308183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc319ab-ed71-4d50-9888-639358302b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.308709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc319ab-ed71-4d50-9888-639358302b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.309480 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc319ab-ed71-4d50-9888-639358302b7d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:09.309798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc319ab-ed71-4d50-9888-639358302b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.311449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc319ab-ed71-4d50-9888-639358302b7d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.314123 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-33aa0867-6aa1-45a8-8d69-8e87af4da92c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:09.315332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-33aa0867-6aa1-45a8-8d69-8e87af4da92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:09.329890 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 205/405] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:24:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:09.336595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc319ab-ed71-4d50-9888-639358302b7d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.336880 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 201/406] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:09.347204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc319ab-ed71-4d50-9888-639358302b7d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.357359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6408eac-9890-444e-a2c3-3ff6b26f7590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.358619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408eac-9890-444e-a2c3-3ff6b26f7590 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.359112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408eac-9890-444e-a2c3-3ff6b26f7590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.359594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408eac-9890-444e-a2c3-3ff6b26f7590 admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.360280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa0867-6aa1-45a8-8d69-8e87af4da92c None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.367200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6408eac-9890-444e-a2c3-3ff6b26f7590 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.370285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6408eac-9890-444e-a2c3-3ff6b26f7590 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.372302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 206/407] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:09 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:09.372819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa0867-6aa1-45a8-8d69-8e87af4da92c None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.378335 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6408eac-9890-444e-a2c3-3ff6b26f7590 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.387508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ce7f3-b41b-499c-bc70-f1ab4c25dd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.388343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ce7f3-b41b-499c-bc70-f1ab4c25dd09 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.388624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ce7f3-b41b-499c-bc70-f1ab4c25dd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.388897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ce7f3-b41b-499c-bc70-f1ab4c25dd09 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.390233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6408eac-9890-444e-a2c3-3ff6b26f7590 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.395063 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574c2dd-8ca5-413e-9dba-54907bc5b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.396186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c2dd-8ca5-413e-9dba-54907bc5b6dc admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.396636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c2dd-8ca5-413e-9dba-54907bc5b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.397119 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c2dd-8ca5-413e-9dba-54907bc5b6dc admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.398618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574c2dd-8ca5-413e-9dba-54907bc5b6dc admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.400914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574c2dd-8ca5-413e-9dba-54907bc5b6dc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.403176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 207/408] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:09 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:09.408946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574c2dd-8ca5-413e-9dba-54907bc5b6dc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.410613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ce7f3-b41b-499c-bc70-f1ab4c25dd09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:09.418206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-ae1ce7f3-b41b-499c-bc70-f1ab4c25dd09 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:24:09.419618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 202/409] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:09.420695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574c2dd-8ca5-413e-9dba-54907bc5b6dc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.431382 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ce7f3-b41b-499c-bc70-f1ab4c25dd09 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.431972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77310081-c94b-4437-86e6-6fe58213e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.433096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310081-c94b-4437-86e6-6fe58213e043 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.433832 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310081-c94b-4437-86e6-6fe58213e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.434275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310081-c94b-4437-86e6-6fe58213e043 admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/groups/8e46d0baeed9487fa228167324924e80/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.436467 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77310081-c94b-4437-86e6-6fe58213e043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4effb777734052bf15ab6d7cf3d2d4, group_id=8e46d0baeed9487fa228167324924e80, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.439380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77310081-c94b-4437-86e6-6fe58213e043 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.452419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ce7f3-b41b-499c-bc70-f1ab4c25dd09 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.457605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 208/410] 10.222.0.83 () {58 vars in 1463 bytes} [Wed Dec 15 13:24:09 2021] PUT /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4/groups/8e46d0baeed9487fa228167324924e80/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:09.523279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c61e4b-2d39-46f9-a03e-8a405c529624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.524274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c61e4b-2d39-46f9-a03e-8a405c529624 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.524700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c61e4b-2d39-46f9-a03e-8a405c529624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.525130 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c61e4b-2d39-46f9-a03e-8a405c529624 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.526143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c61e4b-2d39-46f9-a03e-8a405c529624 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:09.526599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c61e4b-2d39-46f9-a03e-8a405c529624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.528394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c61e4b-2d39-46f9-a03e-8a405c529624 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.538273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 203/411] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:09.545312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77310081-c94b-4437-86e6-6fe58213e043 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.556310 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77310081-c94b-4437-86e6-6fe58213e043 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.561391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a13bd8-d276-4b17-8377-1a382cc05960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.562467 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13bd8-d276-4b17-8377-1a382cc05960 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.562889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13bd8-d276-4b17-8377-1a382cc05960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.563405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13bd8-d276-4b17-8377-1a382cc05960 admin admin] PATH_INFO: `/v3/groups/b7f10f714f2d4255b841f6467b5c52ca` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.564888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a13bd8-d276-4b17-8377-1a382cc05960 admin admin] RBAC: Authorizing `identity:get_group(group_id=b7f10f714f2d4255b841f6467b5c52ca)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.567061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a13bd8-d276-4b17-8377-1a382cc05960 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.568917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 209/412] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:09 2021] GET /identity/v3/groups/b7f10f714f2d4255b841f6467b5c52ca => generated 229 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:09.575688 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c61e4b-2d39-46f9-a03e-8a405c529624 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.586976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c61e4b-2d39-46f9-a03e-8a405c529624 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.591806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db405f5d-82ca-45d0-9618-97d9bef6e693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.592862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405f5d-82ca-45d0-9618-97d9bef6e693 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.593332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405f5d-82ca-45d0-9618-97d9bef6e693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.593740 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405f5d-82ca-45d0-9618-97d9bef6e693 admin admin] PATH_INFO: `/v3/projects/0f70e030dc594b37825ba3900598d4c4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.595216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db405f5d-82ca-45d0-9618-97d9bef6e693 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f70e030dc594b37825ba3900598d4c4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.597167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db405f5d-82ca-45d0-9618-97d9bef6e693 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.599474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 204/413] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:09 2021] GET /identity/v3/projects/0f70e030dc594b37825ba3900598d4c4 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:09.605885 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a13bd8-d276-4b17-8377-1a382cc05960 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:09.616718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a13bd8-d276-4b17-8377-1a382cc05960 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:09.623553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f16a7-6004-452b-a6e6-7e5cf6dc8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:09.624695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f16a7-6004-452b-a6e6-7e5cf6dc8bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:09.625116 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f16a7-6004-452b-a6e6-7e5cf6dc8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:09.625564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f16a7-6004-452b-a6e6-7e5cf6dc8bfc admin admin] PATH_INFO: `/v3/projects/0f70e030dc594b37825ba3900598d4c4/groups/b7f10f714f2d4255b841f6467b5c52ca/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:09.627832 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f16a7-6004-452b-a6e6-7e5cf6dc8bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f70e030dc594b37825ba3900598d4c4, group_id=b7f10f714f2d4255b841f6467b5c52ca, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:09.630662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f16a7-6004-452b-a6e6-7e5cf6dc8bfc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:09.652137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 210/414] 10.222.0.83 () {58 vars in 1463 bytes} [Wed Dec 15 13:24:09 2021] PUT /identity/v3/projects/0f70e030dc594b37825ba3900598d4c4/groups/b7f10f714f2d4255b841f6467b5c52ca/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:10.659008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeddbe9-1779-4a19-8e18-a23dd958c7f0 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:10.659491 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeddbe9-1779-4a19-8e18-a23dd958c7f0 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:10.659568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeddbe9-1779-4a19-8e18-a23dd958c7f0 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:10.661643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 205/415] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:10.667647 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7c36-febc-44cc-a279-665963d7531a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:10.668068 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7c36-febc-44cc-a279-665963d7531a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:10.668254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7c36-febc-44cc-a279-665963d7531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:10.690777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a1ea7c36-febc-44cc-a279-665963d7531a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:10.691953 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a1ea7c36-febc-44cc-a279-665963d7531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:10.759083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 211/416] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:10.804245 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeddbe9-1779-4a19-8e18-a23dd958c7f0 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:10.821027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeddbe9-1779-4a19-8e18-a23dd958c7f0 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:10.826681 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98280f-3c2f-46fe-918d-d6a26a858a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:10.827583 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98280f-3c2f-46fe-918d-d6a26a858a28 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:10.827864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98280f-3c2f-46fe-918d-d6a26a858a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:10.828136 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98280f-3c2f-46fe-918d-d6a26a858a28 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:10.844235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98280f-3c2f-46fe-918d-d6a26a858a28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:10.851737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-bc98280f-3c2f-46fe-918d-d6a26a858a28 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:24:10.853254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 206/417] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:10.859490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea7c36-febc-44cc-a279-665963d7531a None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:10.869114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea7c36-febc-44cc-a279-665963d7531a None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:10.874679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c98fbd-4479-445b-b2e6-25919ff4f916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:10.875360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c98fbd-4479-445b-b2e6-25919ff4f916 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:10.875640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c98fbd-4479-445b-b2e6-25919ff4f916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:10.875913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c98fbd-4479-445b-b2e6-25919ff4f916 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:10.876677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c98fbd-4479-445b-b2e6-25919ff4f916 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:10.876984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c98fbd-4479-445b-b2e6-25919ff4f916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:10.878597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c98fbd-4479-445b-b2e6-25919ff4f916 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:10.888388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 212/418] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:10.894257 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98280f-3c2f-46fe-918d-d6a26a858a28 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:10.907632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98280f-3c2f-46fe-918d-d6a26a858a28 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:10.916028 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1a6ce-1a56-4fef-a41a-f09f0dbeb0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:10.916683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1a6ce-1a56-4fef-a41a-f09f0dbeb0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:10.916964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1a6ce-1a56-4fef-a41a-f09f0dbeb0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:10.917240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1a6ce-1a56-4fef-a41a-f09f0dbeb0ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:10.929056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1a6ce-1a56-4fef-a41a-f09f0dbeb0ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:10.930835 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1a6ce-1a56-4fef-a41a-f09f0dbeb0ad admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:10.943567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 207/419] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:10.950097 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c98fbd-4479-445b-b2e6-25919ff4f916 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:10.960017 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c98fbd-4479-445b-b2e6-25919ff4f916 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:10.971287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dcca3-766f-4b65-a6ae-49a9d57a249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:10.972171 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcca3-766f-4b65-a6ae-49a9d57a249d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:10.972449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcca3-766f-4b65-a6ae-49a9d57a249d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:10.972724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcca3-766f-4b65-a6ae-49a9d57a249d admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:10.973974 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dcca3-766f-4b65-a6ae-49a9d57a249d admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:10.976544 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dcca3-766f-4b65-a6ae-49a9d57a249d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:10.982189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 213/420] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:10 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:10.987943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1a6ce-1a56-4fef-a41a-f09f0dbeb0ad admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:11.001459 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1a6ce-1a56-4fef-a41a-f09f0dbeb0ad admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:11.008579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f4e94-4399-4cdd-8636-d8522d3247ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:11.009466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f4e94-4399-4cdd-8636-d8522d3247ea admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:11.009787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f4e94-4399-4cdd-8636-d8522d3247ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:11.010048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f4e94-4399-4cdd-8636-d8522d3247ea admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:11.014724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f4e94-4399-4cdd-8636-d8522d3247ea admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:11.016694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f4e94-4399-4cdd-8636-d8522d3247ea admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:11.018807 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 208/421] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:10 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:11.025072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dcca3-766f-4b65-a6ae-49a9d57a249d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:11.035456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dcca3-766f-4b65-a6ae-49a9d57a249d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:11.045622 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076990f7-9995-4d52-a0e4-b718728c905e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:11.046331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076990f7-9995-4d52-a0e4-b718728c905e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:11.046612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076990f7-9995-4d52-a0e4-b718728c905e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:11.046889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076990f7-9995-4d52-a0e4-b718728c905e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:11.047806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076990f7-9995-4d52-a0e4-b718728c905e admin admin] RBAC: Adding query filter params (group.id=8e46d0baeed9487fa228167324924e80, role.id=78ec5da190bd41768cafe7cade4d3d69, scope.project.id=eb37d41816d74f66a5087e325e84211f) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:11.048067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076990f7-9995-4d52-a0e4-b718728c905e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:11.049948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076990f7-9995-4d52-a0e4-b718728c905e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:11.057134 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 214/422] 10.222.0.83 () {56 vars in 1397 bytes} [Wed Dec 15 13:24:11 2021] GET /identity/v3/role_assignments?group.id=8e46d0baeed9487fa228167324924e80&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=78ec5da190bd41768cafe7cade4d3d69 => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:11.453239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b39b2-5848-4fa6-869d-7b8a1d0cf5ed None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:11.453625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b39b2-5848-4fa6-869d-7b8a1d0cf5ed None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:11.453812 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b39b2-5848-4fa6-869d-7b8a1d0cf5ed None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:11.455867 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 209/423] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:11.463445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba44a94-cbde-431a-bfb5-ce879fe1f250 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:11.463728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba44a94-cbde-431a-bfb5-ce879fe1f250 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:11.464000 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba44a94-cbde-431a-bfb5-ce879fe1f250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:11.486525 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-9ba44a94-cbde-431a-bfb5-ce879fe1f250 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:11.487732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9ba44a94-cbde-431a-bfb5-ce879fe1f250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:11.498732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 215/424] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:11.523964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b39b2-5848-4fa6-869d-7b8a1d0cf5ed None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:11.536932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b39b2-5848-4fa6-869d-7b8a1d0cf5ed None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:11.542810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a61e45-2ad4-4ec0-9647-198f48d15629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:11.543610 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a61e45-2ad4-4ec0-9647-198f48d15629 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:11.543885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a61e45-2ad4-4ec0-9647-198f48d15629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:11.544155 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a61e45-2ad4-4ec0-9647-198f48d15629 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:11.557268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a61e45-2ad4-4ec0-9647-198f48d15629 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:11.565731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-63a61e45-2ad4-4ec0-9647-198f48d15629 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:24:11.572566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 210/425] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:11.574055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba44a94-cbde-431a-bfb5-ce879fe1f250 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:11.584530 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba44a94-cbde-431a-bfb5-ce879fe1f250 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:11.590273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa94856-b55d-48e5-92b0-9d6564312370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:11.590954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa94856-b55d-48e5-92b0-9d6564312370 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:11.591234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa94856-b55d-48e5-92b0-9d6564312370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:11.591508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa94856-b55d-48e5-92b0-9d6564312370 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:11.592273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa94856-b55d-48e5-92b0-9d6564312370 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:11.592575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa94856-b55d-48e5-92b0-9d6564312370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:11.594195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa94856-b55d-48e5-92b0-9d6564312370 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:11.603813 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 216/426] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:24:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:11.610007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a61e45-2ad4-4ec0-9647-198f48d15629 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:11.621685 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a61e45-2ad4-4ec0-9647-198f48d15629 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:11.630237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20315231-4c71-4f8d-8450-63d55ffe99a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:11.630942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20315231-4c71-4f8d-8450-63d55ffe99a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:11.631223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20315231-4c71-4f8d-8450-63d55ffe99a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:11.632022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20315231-4c71-4f8d-8450-63d55ffe99a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:11.643549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20315231-4c71-4f8d-8450-63d55ffe99a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:11.645340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20315231-4c71-4f8d-8450-63d55ffe99a1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:11.661908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 211/427] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:11.667234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa94856-b55d-48e5-92b0-9d6564312370 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:11.679612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa94856-b55d-48e5-92b0-9d6564312370 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:11.684443 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6abc1-c35c-4195-bb0a-7d0131f54b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:11.685378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6abc1-c35c-4195-bb0a-7d0131f54b43 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:11.685666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6abc1-c35c-4195-bb0a-7d0131f54b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:11.686007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6abc1-c35c-4195-bb0a-7d0131f54b43 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:11.687328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6abc1-c35c-4195-bb0a-7d0131f54b43 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:11.689555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6abc1-c35c-4195-bb0a-7d0131f54b43 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:11.691415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 217/428] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:11 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:11.698012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20315231-4c71-4f8d-8450-63d55ffe99a1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:11.707653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20315231-4c71-4f8d-8450-63d55ffe99a1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:11.713522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931a74-7c1e-47f1-9cc6-d66931ba9879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:11.714472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931a74-7c1e-47f1-9cc6-d66931ba9879 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:11.714751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931a74-7c1e-47f1-9cc6-d66931ba9879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:11.715024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931a74-7c1e-47f1-9cc6-d66931ba9879 admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:11.716387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a931a74-7c1e-47f1-9cc6-d66931ba9879 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:11.718495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a931a74-7c1e-47f1-9cc6-d66931ba9879 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:11.725856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 212/429] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:11 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:11.728944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6abc1-c35c-4195-bb0a-7d0131f54b43 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:11.740002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6abc1-c35c-4195-bb0a-7d0131f54b43 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:11.744891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b24d1-068d-47f6-ac9a-12bcba2d5616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:11.745610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b24d1-068d-47f6-ac9a-12bcba2d5616 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:11.745935 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b24d1-068d-47f6-ac9a-12bcba2d5616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:11.746219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b24d1-068d-47f6-ac9a-12bcba2d5616 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:11.747127 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b24d1-068d-47f6-ac9a-12bcba2d5616 admin admin] RBAC: Adding query filter params (group.id=8e46d0baeed9487fa228167324924e80, role.id=78401ee743b448d48b6c94ff8642907e, scope.project.id=eb37d41816d74f66a5087e325e84211f) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:11.747441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b24d1-068d-47f6-ac9a-12bcba2d5616 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:11.749435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b24d1-068d-47f6-ac9a-12bcba2d5616 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:11.765947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 218/430] 10.222.0.83 () {56 vars in 1397 bytes} [Wed Dec 15 13:24:11 2021] GET /identity/v3/role_assignments?group.id=8e46d0baeed9487fa228167324924e80&scope.project.id=eb37d41816d74f66a5087e325e84211f&role.id=78401ee743b448d48b6c94ff8642907e => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:12.151076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690687d-fe67-4589-b536-9b426333c5b5 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.151544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690687d-fe67-4589-b536-9b426333c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.151712 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690687d-fe67-4589-b536-9b426333c5b5 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.153503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 213/431] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:12.159326 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1e9a3-ae6e-42d1-9ca6-19e275434720 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.159611 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1e9a3-ae6e-42d1-9ca6-19e275434720 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.159886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1e9a3-ae6e-42d1-9ca6-19e275434720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.179038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-3bc1e9a3-ae6e-42d1-9ca6-19e275434720 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:12.180218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3bc1e9a3-ae6e-42d1-9ca6-19e275434720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:12.188336 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 219/432] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:12.212473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690687d-fe67-4589-b536-9b426333c5b5 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.224705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690687d-fe67-4589-b536-9b426333c5b5 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.229385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c0374-b21f-47ec-ae5c-378843032276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.230228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c0374-b21f-47ec-ae5c-378843032276 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.230503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c0374-b21f-47ec-ae5c-378843032276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.230771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c0374-b21f-47ec-ae5c-378843032276 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.243044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c0374-b21f-47ec-ae5c-378843032276 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:12.250307 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-738c0374-b21f-47ec-ae5c-378843032276 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:24:12.251818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 214/433] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:12.258503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1e9a3-ae6e-42d1-9ca6-19e275434720 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.267747 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1e9a3-ae6e-42d1-9ca6-19e275434720 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.273522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912b7f5-a58e-4a97-b707-50d2d6927531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.274451 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912b7f5-a58e-4a97-b707-50d2d6927531 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.274931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912b7f5-a58e-4a97-b707-50d2d6927531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.275403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912b7f5-a58e-4a97-b707-50d2d6927531 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.276356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912b7f5-a58e-4a97-b707-50d2d6927531 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:12.276924 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912b7f5-a58e-4a97-b707-50d2d6927531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:12.278853 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912b7f5-a58e-4a97-b707-50d2d6927531 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:12.288538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 220/434] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:12.295395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c0374-b21f-47ec-ae5c-378843032276 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.307111 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c0374-b21f-47ec-ae5c-378843032276 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.312263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8553890-f862-4805-b665-81e16e1df316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.313157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8553890-f862-4805-b665-81e16e1df316 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.313617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8553890-f862-4805-b665-81e16e1df316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.314156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8553890-f862-4805-b665-81e16e1df316 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.324540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8553890-f862-4805-b665-81e16e1df316 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:12.326599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8553890-f862-4805-b665-81e16e1df316 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:12.337056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 215/435] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:12.344933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912b7f5-a58e-4a97-b707-50d2d6927531 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.355565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912b7f5-a58e-4a97-b707-50d2d6927531 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.363896 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f8030-d957-4baf-8c1d-979199de4b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.364947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f8030-d957-4baf-8c1d-979199de4b3c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.365336 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f8030-d957-4baf-8c1d-979199de4b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.365698 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f8030-d957-4baf-8c1d-979199de4b3c admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.367726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f8030-d957-4baf-8c1d-979199de4b3c admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:12.369971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f8030-d957-4baf-8c1d-979199de4b3c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:12.372147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 221/436] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:12.378093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8553890-f862-4805-b665-81e16e1df316 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.390004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8553890-f862-4805-b665-81e16e1df316 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.394675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0705b-03a8-45f2-8be5-90b8dc3df16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.395532 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0705b-03a8-45f2-8be5-90b8dc3df16a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.395844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0705b-03a8-45f2-8be5-90b8dc3df16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.396111 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0705b-03a8-45f2-8be5-90b8dc3df16a admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.397337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0705b-03a8-45f2-8be5-90b8dc3df16a admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:12.399336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0705b-03a8-45f2-8be5-90b8dc3df16a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:12.401349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 216/437] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:12.408863 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f8030-d957-4baf-8c1d-979199de4b3c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.419432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f8030-d957-4baf-8c1d-979199de4b3c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.424356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4585b-0dfd-4128-8782-731dde19a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.425063 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4585b-0dfd-4128-8782-731dde19a51d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.425346 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4585b-0dfd-4128-8782-731dde19a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.425679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4585b-0dfd-4128-8782-731dde19a51d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.426665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4585b-0dfd-4128-8782-731dde19a51d admin admin] RBAC: Adding query filter params (group.id=8e46d0baeed9487fa228167324924e80, role.id=78ec5da190bd41768cafe7cade4d3d69, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:12.428202 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4585b-0dfd-4128-8782-731dde19a51d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:12.430636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4585b-0dfd-4128-8782-731dde19a51d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:12.437650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 222/438] 10.222.0.83 () {56 vars in 1397 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/role_assignments?group.id=8e46d0baeed9487fa228167324924e80&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=78ec5da190bd41768cafe7cade4d3d69 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:12.768177 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330155b1-821c-4b15-a1f0-0b16db459d13 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.768760 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330155b1-821c-4b15-a1f0-0b16db459d13 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.768910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330155b1-821c-4b15-a1f0-0b16db459d13 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.770592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 217/439] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:12.776831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864b5cf-fe55-4b4c-aa1b-2fc1821b6edc None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.777244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864b5cf-fe55-4b4c-aa1b-2fc1821b6edc None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.777387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864b5cf-fe55-4b4c-aa1b-2fc1821b6edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.795619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e864b5cf-fe55-4b4c-aa1b-2fc1821b6edc None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:12.796804 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e864b5cf-fe55-4b4c-aa1b-2fc1821b6edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:12.804231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 223/440] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:12.828588 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330155b1-821c-4b15-a1f0-0b16db459d13 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.840816 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330155b1-821c-4b15-a1f0-0b16db459d13 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.845147 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19950ad2-f0cc-49da-ae2a-1b4dd8f11990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.845948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950ad2-f0cc-49da-ae2a-1b4dd8f11990 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.846229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950ad2-f0cc-49da-ae2a-1b4dd8f11990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.846502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950ad2-f0cc-49da-ae2a-1b4dd8f11990 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.857030 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19950ad2-f0cc-49da-ae2a-1b4dd8f11990 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:12.863844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-19950ad2-f0cc-49da-ae2a-1b4dd8f11990 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 13:24:12.864996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 218/441] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:12.867765 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee30a-52ad-4411-90df-0a598e751936 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.868057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee30a-52ad-4411-90df-0a598e751936 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.868332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee30a-52ad-4411-90df-0a598e751936 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.870242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 224/442] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:12.871018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19950ad2-f0cc-49da-ae2a-1b4dd8f11990 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.875527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c4047-558c-4b8d-aa39-75b03184a68d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.875810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c4047-558c-4b8d-aa39-75b03184a68d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.876087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c4047-558c-4b8d-aa39-75b03184a68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.880726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19950ad2-f0cc-49da-ae2a-1b4dd8f11990 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.885290 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf5b05-5929-4eac-b947-ed7ef0c92bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.885983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5b05-5929-4eac-b947-ed7ef0c92bcc admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.886264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5b05-5929-4eac-b947-ed7ef0c92bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.886537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5b05-5929-4eac-b947-ed7ef0c92bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.887289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf5b05-5929-4eac-b947-ed7ef0c92bcc admin admin] RBAC: Adding query filter params (name=member) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:12.887590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf5b05-5929-4eac-b947-ed7ef0c92bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:12.889172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf5b05-5929-4eac-b947-ed7ef0c92bcc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:12.894257 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-378c4047-558c-4b8d-aa39-75b03184a68d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:12.895436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-378c4047-558c-4b8d-aa39-75b03184a68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:12.898538 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 219/443] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:12.904633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 225/444] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:12.904771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf5b05-5929-4eac-b947-ed7ef0c92bcc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.913796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf5b05-5929-4eac-b947-ed7ef0c92bcc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.918039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72194beb-9080-4193-ab29-2760fe26d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.918638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194beb-9080-4193-ab29-2760fe26d6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.918917 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194beb-9080-4193-ab29-2760fe26d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.919188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194beb-9080-4193-ab29-2760fe26d6f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.926613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72194beb-9080-4193-ab29-2760fe26d6f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:12.927959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c4047-558c-4b8d-aa39-75b03184a68d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.928331 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72194beb-9080-4193-ab29-2760fe26d6f7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:12.936815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c4047-558c-4b8d-aa39-75b03184a68d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.937303 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 220/445] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:24:12.941228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ddc9e-8c33-4fac-bedd-ed8bc022dd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.942105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ddc9e-8c33-4fac-bedd-ed8bc022dd7f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.942377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ddc9e-8c33-4fac-bedd-ed8bc022dd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.942641 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ddc9e-8c33-4fac-bedd-ed8bc022dd7f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.942835 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72194beb-9080-4193-ab29-2760fe26d6f7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.951014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72194beb-9080-4193-ab29-2760fe26d6f7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.952798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ddc9e-8c33-4fac-bedd-ed8bc022dd7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:12.955522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5fa37-133e-4a87-b01a-db9804bac7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.956343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5fa37-133e-4a87-b01a-db9804bac7bf admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.956624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5fa37-133e-4a87-b01a-db9804bac7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.956899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5fa37-133e-4a87-b01a-db9804bac7bf admin admin] PATH_INFO: `/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.958094 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5fa37-133e-4a87-b01a-db9804bac7bf admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4effb777734052bf15ab6d7cf3d2d4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:12.960225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-8b6ddc9e-8c33-4fac-bedd-ed8bc022dd7f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:24:12.960582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5fa37-133e-4a87-b01a-db9804bac7bf admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:12.961361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 226/446] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:12.967605 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 221/447] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/projects/8a4effb777734052bf15ab6d7cf3d2d4 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:12.967724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ddc9e-8c33-4fac-bedd-ed8bc022dd7f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.968599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5fa37-133e-4a87-b01a-db9804bac7bf admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.977198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ddc9e-8c33-4fac-bedd-ed8bc022dd7f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.978302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5fa37-133e-4a87-b01a-db9804bac7bf admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:12.981455 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6db22-2464-40ac-9352-8f4919298e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.982052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6db22-2464-40ac-9352-8f4919298e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.982328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6db22-2464-40ac-9352-8f4919298e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.982435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6531a5b-c653-4909-9314-3286ea736a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:12.982606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6db22-2464-40ac-9352-8f4919298e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.983211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531a5b-c653-4909-9314-3286ea736a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:12.983346 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6db22-2464-40ac-9352-8f4919298e6e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:12.983483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531a5b-c653-4909-9314-3286ea736a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:12.983644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6db22-2464-40ac-9352-8f4919298e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:12.983751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531a5b-c653-4909-9314-3286ea736a0e admin admin] PATH_INFO: `/v3/groups/8e46d0baeed9487fa228167324924e80` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:12.984903 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6531a5b-c653-4909-9314-3286ea736a0e admin admin] RBAC: Authorizing `identity:get_group(group_id=8e46d0baeed9487fa228167324924e80)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:12.985206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6db22-2464-40ac-9352-8f4919298e6e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:12.986767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6531a5b-c653-4909-9314-3286ea736a0e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:12.988291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 222/448] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/groups/8e46d0baeed9487fa228167324924e80 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:12.993965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 227/449] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:12.994372 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6531a5b-c653-4909-9314-3286ea736a0e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:12.999421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6db22-2464-40ac-9352-8f4919298e6e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:13.003616 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6531a5b-c653-4909-9314-3286ea736a0e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:13.007853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9df06-2d5f-424a-9e84-59c790147461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:13.008406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6db22-2464-40ac-9352-8f4919298e6e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:13.008499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9df06-2d5f-424a-9e84-59c790147461 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:13.008720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9df06-2d5f-424a-9e84-59c790147461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:13.008988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9df06-2d5f-424a-9e84-59c790147461 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:13.009830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9df06-2d5f-424a-9e84-59c790147461 admin admin] RBAC: Adding query filter params (group.id=8e46d0baeed9487fa228167324924e80, role.id=78401ee743b448d48b6c94ff8642907e, scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:13.010133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9df06-2d5f-424a-9e84-59c790147461 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:13.011910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9df06-2d5f-424a-9e84-59c790147461 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:13.012623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b47e6b-38fa-4866-b120-382bcda9353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:13.013222 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b47e6b-38fa-4866-b120-382bcda9353f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:13.013505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b47e6b-38fa-4866-b120-382bcda9353f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:13.013850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b47e6b-38fa-4866-b120-382bcda9353f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:13.030698 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 223/450] 10.222.0.83 () {56 vars in 1397 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/role_assignments?group.id=8e46d0baeed9487fa228167324924e80&scope.project.id=8a4effb777734052bf15ab6d7cf3d2d4&role.id=78401ee743b448d48b6c94ff8642907e => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:13.030918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b47e6b-38fa-4866-b120-382bcda9353f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:13.030918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b47e6b-38fa-4866-b120-382bcda9353f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:13.033661 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 228/451] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:24:13.040640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9df06-2d5f-424a-9e84-59c790147461 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:13.050712 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9df06-2d5f-424a-9e84-59c790147461 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:13.055312 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2906e2e-b65e-4e55-92e8-a6ec9d162943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:13.056188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906e2e-b65e-4e55-92e8-a6ec9d162943 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:13.056465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906e2e-b65e-4e55-92e8-a6ec9d162943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:13.056735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906e2e-b65e-4e55-92e8-a6ec9d162943 admin admin] PATH_INFO: `/v3/projects/0f70e030dc594b37825ba3900598d4c4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:13.058019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2906e2e-b65e-4e55-92e8-a6ec9d162943 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f70e030dc594b37825ba3900598d4c4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:13.060073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2906e2e-b65e-4e55-92e8-a6ec9d162943 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:13.062007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 224/452] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:24:13 2021] GET /identity/v3/projects/0f70e030dc594b37825ba3900598d4c4 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:13.067925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b47e6b-38fa-4866-b120-382bcda9353f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:13.077237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b47e6b-38fa-4866-b120-382bcda9353f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:13.081810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313a2b2-fec0-4946-8aad-22cf3530a2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:13.082692 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313a2b2-fec0-4946-8aad-22cf3530a2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:13.082968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313a2b2-fec0-4946-8aad-22cf3530a2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:13.083239 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313a2b2-fec0-4946-8aad-22cf3530a2a2 admin admin] PATH_INFO: `/v3/groups/b7f10f714f2d4255b841f6467b5c52ca` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:13.084515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313a2b2-fec0-4946-8aad-22cf3530a2a2 admin admin] RBAC: Authorizing `identity:get_group(group_id=b7f10f714f2d4255b841f6467b5c52ca)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:13.086960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313a2b2-fec0-4946-8aad-22cf3530a2a2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:13.088587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 229/453] 10.222.0.83 () {56 vars in 1201 bytes} [Wed Dec 15 13:24:13 2021] GET /identity/v3/groups/b7f10f714f2d4255b841f6467b5c52ca => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:13.095036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2906e2e-b65e-4e55-92e8-a6ec9d162943 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:13.105617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2906e2e-b65e-4e55-92e8-a6ec9d162943 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:13.110099 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae9767-ecd6-4011-8b2e-164bbbdad860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:13.110747 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae9767-ecd6-4011-8b2e-164bbbdad860 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:13.111027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae9767-ecd6-4011-8b2e-164bbbdad860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:13.111299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae9767-ecd6-4011-8b2e-164bbbdad860 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:13.112146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae9767-ecd6-4011-8b2e-164bbbdad860 admin admin] RBAC: Adding query filter params (group.id=b7f10f714f2d4255b841f6467b5c52ca, role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=0f70e030dc594b37825ba3900598d4c4) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:13.112459 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae9767-ecd6-4011-8b2e-164bbbdad860 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:13.114359 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae9767-ecd6-4011-8b2e-164bbbdad860 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:13.120854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 225/454] 10.222.0.83 () {56 vars in 1397 bytes} [Wed Dec 15 13:24:13 2021] GET /identity/v3/role_assignments?group.id=b7f10f714f2d4255b841f6467b5c52ca&scope.project.id=0f70e030dc594b37825ba3900598d4c4&role.id=a312b345efeb490eb4234d1ace386dec => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:16.223622 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56210-c97b-46ad-819c-320821c3bef2 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.224135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56210-c97b-46ad-819c-320821c3bef2 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.224135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56210-c97b-46ad-819c-320821c3bef2 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.226251 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 230/455] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:16.231822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d673b-7c75-4870-8ecc-8ed7efa74635 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.232227 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d673b-7c75-4870-8ecc-8ed7efa74635 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.232521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d673b-7c75-4870-8ecc-8ed7efa74635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.254875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-874d673b-7c75-4870-8ecc-8ed7efa74635 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:16.256089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-874d673b-7c75-4870-8ecc-8ed7efa74635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:16.270033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 226/456] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:16.298607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb56210-c97b-46ad-819c-320821c3bef2 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:16.314423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb56210-c97b-46ad-819c-320821c3bef2 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:16.319452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18311ef1-79c5-415d-aae4-95eb3107fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:16.320260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18311ef1-79c5-415d-aae4-95eb3107fd6e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.320538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18311ef1-79c5-415d-aae4-95eb3107fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.320805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18311ef1-79c5-415d-aae4-95eb3107fd6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.331844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18311ef1-79c5-415d-aae4-95eb3107fd6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:16.333834 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18311ef1-79c5-415d-aae4-95eb3107fd6e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:16.354907 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-18311ef1-79c5-415d-aae4-95eb3107fd6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:16.356394 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 231/457] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:16.362409 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d673b-7c75-4870-8ecc-8ed7efa74635 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:16.375810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d673b-7c75-4870-8ecc-8ed7efa74635 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:16.384429 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4befb7-0474-44d9-b59e-3da0919ccca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:16.385110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4befb7-0474-44d9-b59e-3da0919ccca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.385392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4befb7-0474-44d9-b59e-3da0919ccca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.385670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4befb7-0474-44d9-b59e-3da0919ccca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.386475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4befb7-0474-44d9-b59e-3da0919ccca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:16.386780 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4befb7-0474-44d9-b59e-3da0919ccca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:16.387832 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-8f4befb7-0474-44d9-b59e-3da0919ccca4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:16.387832 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:24:16.387832 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:24:16.388720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4befb7-0474-44d9-b59e-3da0919ccca4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:16.413788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20a06-380a-40c2-80a6-7e1cfc378e8a None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.414136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20a06-380a-40c2-80a6-7e1cfc378e8a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.414340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d20a06-380a-40c2-80a6-7e1cfc378e8a None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.416212 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 232/458] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:16.420026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 227/459] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:16.426209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4415b5b-f14e-4a00-aae3-5100bc84c6b1 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.426507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4415b5b-f14e-4a00-aae3-5100bc84c6b1 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.426755 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4415b5b-f14e-4a00-aae3-5100bc84c6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.429247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4befb7-0474-44d9-b59e-3da0919ccca4 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:16.443167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4befb7-0474-44d9-b59e-3da0919ccca4 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:16.448436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8878db-524e-4f1d-952d-1a09448da389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:16.449124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8878db-524e-4f1d-952d-1a09448da389 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.449403 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8878db-524e-4f1d-952d-1a09448da389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.449677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8878db-524e-4f1d-952d-1a09448da389 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.450456 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8878db-524e-4f1d-952d-1a09448da389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:16.452373 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8878db-524e-4f1d-952d-1a09448da389 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:16.464084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d4415b5b-f14e-4a00-aae3-5100bc84c6b1 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:16.465466 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d4415b5b-f14e-4a00-aae3-5100bc84c6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:16.474416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 233/460] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:16.477940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 228/461] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:24:16 2021] POST /identity/v3/users => generated 246 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:16.500404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4415b5b-f14e-4a00-aae3-5100bc84c6b1 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:16.511571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4415b5b-f14e-4a00-aae3-5100bc84c6b1 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:16.516669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1da07-1a41-4d71-9d3d-2a2bfed37d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:16.517734 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1da07-1a41-4d71-9d3d-2a2bfed37d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.518261 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1da07-1a41-4d71-9d3d-2a2bfed37d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.518716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1da07-1a41-4d71-9d3d-2a2bfed37d05 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.530764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1da07-1a41-4d71-9d3d-2a2bfed37d05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:16.533087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1da07-1a41-4d71-9d3d-2a2bfed37d05 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:16.551497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-55e1da07-1a41-4d71-9d3d-2a2bfed37d05 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:16.554007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 234/462] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:16.560825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8878db-524e-4f1d-952d-1a09448da389 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:16.579526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8878db-524e-4f1d-952d-1a09448da389 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:16.590645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3569211-3c57-4bdf-a2df-ded298710c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:16.591324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569211-3c57-4bdf-a2df-ded298710c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.591601 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569211-3c57-4bdf-a2df-ded298710c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.591874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569211-3c57-4bdf-a2df-ded298710c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.592615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3569211-3c57-4bdf-a2df-ded298710c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:16.592916 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3569211-3c57-4bdf-a2df-ded298710c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:16.594558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3569211-3c57-4bdf-a2df-ded298710c8d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:16.613614 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 229/463] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:16.619897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1da07-1a41-4d71-9d3d-2a2bfed37d05 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:16.633431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1da07-1a41-4d71-9d3d-2a2bfed37d05 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:16.638256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81eb94-dd44-428b-81e2-ee96c3b388be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:16.639124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81eb94-dd44-428b-81e2-ee96c3b388be admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.639583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81eb94-dd44-428b-81e2-ee96c3b388be admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.640034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81eb94-dd44-428b-81e2-ee96c3b388be admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.641068 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81eb94-dd44-428b-81e2-ee96c3b388be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:16.651473 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81eb94-dd44-428b-81e2-ee96c3b388be admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:16.689349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 235/464] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:24:16 2021] POST /identity/v3/users => generated 248 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:16.889914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e23c0-3b7f-46ff-991e-3bb9b64ee279 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.890314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e23c0-3b7f-46ff-991e-3bb9b64ee279 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.890492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e23c0-3b7f-46ff-991e-3bb9b64ee279 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.892299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 230/465] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:16.898990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eca9d4-aad0-4f1d-9ec5-ed9e6a435d0a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.899342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eca9d4-aad0-4f1d-9ec5-ed9e6a435d0a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.899710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eca9d4-aad0-4f1d-9ec5-ed9e6a435d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.915457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5da148-f286-4033-baf6-06ae43d0a5d7 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.916077 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5da148-f286-4033-baf6-06ae43d0a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.916544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5da148-f286-4033-baf6-06ae43d0a5d7 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.918842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 231/466] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:16.926736 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1102f21-7940-4d61-8e86-78b878c39d09 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.927386 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1102f21-7940-4d61-8e86-78b878c39d09 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.927491 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a4eca9d4-aad0-4f1d-9ec5-ed9e6a435d0a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:16.927962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1102f21-7940-4d61-8e86-78b878c39d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.929226 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a4eca9d4-aad0-4f1d-9ec5-ed9e6a435d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:16.940072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 236/467] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:16.949262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b1102f21-7940-4d61-8e86-78b878c39d09 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:16.950487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b1102f21-7940-4d61-8e86-78b878c39d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:16.958704 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 232/468] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:16.968332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eca9d4-aad0-4f1d-9ec5-ed9e6a435d0a None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:16.979279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eca9d4-aad0-4f1d-9ec5-ed9e6a435d0a None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:16.985189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f4741-d7a3-4a72-b36d-089457e85691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:16.985432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1102f21-7940-4d61-8e86-78b878c39d09 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:16.986469 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f4741-d7a3-4a72-b36d-089457e85691 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:16.987021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f4741-d7a3-4a72-b36d-089457e85691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:16.987486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f4741-d7a3-4a72-b36d-089457e85691 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:16.998678 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1102f21-7940-4d61-8e86-78b878c39d09 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:17.000870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f4741-d7a3-4a72-b36d-089457e85691 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:17.003165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f4741-d7a3-4a72-b36d-089457e85691 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:17.003729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2039c1b-04b7-420d-9be4-39c12c11e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:17.004603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2039c1b-04b7-420d-9be4-39c12c11e970 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:17.004987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2039c1b-04b7-420d-9be4-39c12c11e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:17.005364 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2039c1b-04b7-420d-9be4-39c12c11e970 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:17.017537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2039c1b-04b7-420d-9be4-39c12c11e970 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:17.019677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2039c1b-04b7-420d-9be4-39c12c11e970 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:17.024204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-349f4741-d7a3-4a72-b36d-089457e85691 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:17.030320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 237/469] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:17.032838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f4741-d7a3-4a72-b36d-089457e85691 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:17.043980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f4741-d7a3-4a72-b36d-089457e85691 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:17.047172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-a2039c1b-04b7-420d-9be4-39c12c11e970 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:17.048682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5373db-9aa0-40af-a12a-418abb0ebe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:17.049089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 233/470] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:17.054030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5373db-9aa0-40af-a12a-418abb0ebe6c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:17.054030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5373db-9aa0-40af-a12a-418abb0ebe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:17.054030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5373db-9aa0-40af-a12a-418abb0ebe6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:17.054030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5373db-9aa0-40af-a12a-418abb0ebe6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:17.054030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5373db-9aa0-40af-a12a-418abb0ebe6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:17.054030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5373db-9aa0-40af-a12a-418abb0ebe6c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:17.057355 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2039c1b-04b7-420d-9be4-39c12c11e970 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:17.066850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 238/471] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:17.074121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2039c1b-04b7-420d-9be4-39c12c11e970 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:17.075753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5373db-9aa0-40af-a12a-418abb0ebe6c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:17.081653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb831a-be0e-46ba-8b5f-e2511838062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:17.083189 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb831a-be0e-46ba-8b5f-e2511838062b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:17.083671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb831a-be0e-46ba-8b5f-e2511838062b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:17.084405 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb831a-be0e-46ba-8b5f-e2511838062b admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:17.085396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb831a-be0e-46ba-8b5f-e2511838062b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:17.085924 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb831a-be0e-46ba-8b5f-e2511838062b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:17.086385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5373db-9aa0-40af-a12a-418abb0ebe6c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:17.088055 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb831a-be0e-46ba-8b5f-e2511838062b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:17.094272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b32b7-8b44-4327-a458-2b832bba38da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:17.095035 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b32b7-8b44-4327-a458-2b832bba38da admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:17.095372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b32b7-8b44-4327-a458-2b832bba38da admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:17.095655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b32b7-8b44-4327-a458-2b832bba38da admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:17.096495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b32b7-8b44-4327-a458-2b832bba38da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:17.099022 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b32b7-8b44-4327-a458-2b832bba38da admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:17.104506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 234/472] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:17.112474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb831a-be0e-46ba-8b5f-e2511838062b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:17.125408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 239/473] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:24:17 2021] POST /identity/v3/users => generated 248 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:24:17.127559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb831a-be0e-46ba-8b5f-e2511838062b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:17.133239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c077b-8f7a-497e-977a-f6b2639d8b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:17.134493 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c077b-8f7a-497e-977a-f6b2639d8b86 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:17.135023 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c077b-8f7a-497e-977a-f6b2639d8b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:17.135605 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c077b-8f7a-497e-977a-f6b2639d8b86 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:17.136769 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c077b-8f7a-497e-977a-f6b2639d8b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:17.139314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c077b-8f7a-497e-977a-f6b2639d8b86 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:17.168335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 235/474] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:24:17 2021] POST /identity/v3/users => generated 249 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:24:17.630509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd486-843d-411a-89a5-b4ce4cbc5939 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:17.631008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd486-843d-411a-89a5-b4ce4cbc5939 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:17.631081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd486-843d-411a-89a5-b4ce4cbc5939 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:17.633369 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 240/475] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:17.639464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b478f-245b-43d8-8d58-d76cd0d68268 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:17.639861 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b478f-245b-43d8-8d58-d76cd0d68268 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:17.640040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b478f-245b-43d8-8d58-d76cd0d68268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:17.666780 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-962b478f-245b-43d8-8d58-d76cd0d68268 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:17.668003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-962b478f-245b-43d8-8d58-d76cd0d68268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:17.679085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 236/476] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:17.703525 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dd486-843d-411a-89a5-b4ce4cbc5939 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:17.725066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dd486-843d-411a-89a5-b4ce4cbc5939 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:17.733128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184c4eb-a6c9-4fd5-ae4c-146ee5b20fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:17.733817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184c4eb-a6c9-4fd5-ae4c-146ee5b20fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:17.734102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184c4eb-a6c9-4fd5-ae4c-146ee5b20fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:17.734377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184c4eb-a6c9-4fd5-ae4c-146ee5b20fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:17.735149 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184c4eb-a6c9-4fd5-ae4c-146ee5b20fc8 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:17.736753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184c4eb-a6c9-4fd5-ae4c-146ee5b20fc8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:17.749364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.sql.core [None req-c184c4eb-a6c9-4fd5-ae4c-146ee5b20fc8 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 15 13:24:17.749364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 15 13:24:17.749364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [parameters: {'id': '4002f3818957456a8cd7397e35389871', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 15 13:24:17.749364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79140) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 13:24:17.764743 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-c184c4eb-a6c9-4fd5-ae4c-146ee5b20fc8 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 15 13:24:17.769862 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 241/477] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:24:17 2021] POST /identity/v3/roles => generated 144 bytes in 63 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:17.773348 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b478f-245b-43d8-8d58-d76cd0d68268 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:17.782751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b478f-245b-43d8-8d58-d76cd0d68268 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:17.796913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f57921-1ad1-41c2-8ff8-c394ec2511d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:17.797750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f57921-1ad1-41c2-8ff8-c394ec2511d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:17.798049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f57921-1ad1-41c2-8ff8-c394ec2511d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:17.798325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f57921-1ad1-41c2-8ff8-c394ec2511d2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:17.819497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f57921-1ad1-41c2-8ff8-c394ec2511d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:17.835938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-15f57921-1ad1-41c2-8ff8-c394ec2511d2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 13:24:17.837502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 237/478] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:17.843576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184c4eb-a6c9-4fd5-ae4c-146ee5b20fc8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:17.862907 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184c4eb-a6c9-4fd5-ae4c-146ee5b20fc8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:17.875318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b897ca-1f8a-4433-b36f-f57b43aafc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:17.875992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b897ca-1f8a-4433-b36f-f57b43aafc4c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:17.876272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b897ca-1f8a-4433-b36f-f57b43aafc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:17.876549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b897ca-1f8a-4433-b36f-f57b43aafc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:17.877318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b897ca-1f8a-4433-b36f-f57b43aafc4c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:17.877623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b897ca-1f8a-4433-b36f-f57b43aafc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:17.879263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b897ca-1f8a-4433-b36f-f57b43aafc4c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:17.896425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 242/479] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:17 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:19.742275 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519602f-b7de-44ee-9e80-147b2afb73ad None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.742775 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519602f-b7de-44ee-9e80-147b2afb73ad None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.742847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519602f-b7de-44ee-9e80-147b2afb73ad None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.744595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 238/480] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:19.762422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a4496-6b42-4d40-867c-43ef51c2f05d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.762944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a4496-6b42-4d40-867c-43ef51c2f05d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.763019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a4496-6b42-4d40-867c-43ef51c2f05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.791015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-7f0a4496-6b42-4d40-867c-43ef51c2f05d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:19.792282 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7f0a4496-6b42-4d40-867c-43ef51c2f05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:19.800467 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 243/481] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:19.822511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bf82e-b404-406e-9755-425b160b1d34 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.822994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bf82e-b404-406e-9755-425b160b1d34 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.823468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bf82e-b404-406e-9755-425b160b1d34 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.826347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 239/482] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:19.828066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a4496-6b42-4d40-867c-43ef51c2f05d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:19.831705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a44-5747-4892-930c-da717d5b8350 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.831988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a44-5747-4892-930c-da717d5b8350 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.832258 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a44-5747-4892-930c-da717d5b8350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.850189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a4496-6b42-4d40-867c-43ef51c2f05d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:19.857033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-568b3a44-5747-4892-930c-da717d5b8350 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:19.858289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-568b3a44-5747-4892-930c-da717d5b8350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:19.860970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b104e8-e083-42f7-9ce1-74109da27c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:19.861847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b104e8-e083-42f7-9ce1-74109da27c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.862135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b104e8-e083-42f7-9ce1-74109da27c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.862415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b104e8-e083-42f7-9ce1-74109da27c62 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.875844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b104e8-e083-42f7-9ce1-74109da27c62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:19.883600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-83b104e8-e083-42f7-9ce1-74109da27c62 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:19.884035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 240/483] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:19.885170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 244/484] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:19.891149 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3a44-5747-4892-930c-da717d5b8350 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:19.907231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3a44-5747-4892-930c-da717d5b8350 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:19.907866 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b104e8-e083-42f7-9ce1-74109da27c62 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:19.918919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b104e8-e083-42f7-9ce1-74109da27c62 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:19.923364 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f8c0a-48be-4599-8f55-8acb9a6a4689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:19.923801 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0c5f2-525e-4e4c-aac5-96902c806507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:19.924029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f8c0a-48be-4599-8f55-8acb9a6a4689 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.924316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f8c0a-48be-4599-8f55-8acb9a6a4689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.924591 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0c5f2-525e-4e4c-aac5-96902c806507 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.924755 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f8c0a-48be-4599-8f55-8acb9a6a4689 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.924933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0c5f2-525e-4e4c-aac5-96902c806507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.925222 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0c5f2-525e-4e4c-aac5-96902c806507 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.925382 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f8c0a-48be-4599-8f55-8acb9a6a4689 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:19.925648 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f8c0a-48be-4599-8f55-8acb9a6a4689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:19.927515 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f8c0a-48be-4599-8f55-8acb9a6a4689 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:19.948284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 241/485] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:19.949485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0c5f2-525e-4e4c-aac5-96902c806507 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:19.956795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f8c0a-48be-4599-8f55-8acb9a6a4689 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:19.962041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-64c0c5f2-525e-4e4c-aac5-96902c806507 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:19.969429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 245/486] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:19.969429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70ecda-ccd3-489e-89d6-b491305b5e46 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.969429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70ecda-ccd3-489e-89d6-b491305b5e46 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.969429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70ecda-ccd3-489e-89d6-b491305b5e46 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.970556 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 246/487] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:19.971629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70ecda-ccd3-489e-89d6-b491305b5e46 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:19.973093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f8c0a-48be-4599-8f55-8acb9a6a4689 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:19.982672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483fba9-f382-472a-a0a1-ff81d9daef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:19.983772 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483fba9-f382-472a-a0a1-ff81d9daef40 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.984246 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483fba9-f382-472a-a0a1-ff81d9daef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:19.984706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483fba9-f382-472a-a0a1-ff81d9daef40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:19.991695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70ecda-ccd3-489e-89d6-b491305b5e46 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:19.997499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483fba9-f382-472a-a0a1-ff81d9daef40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:19.998975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2cbf1-6cc8-413c-b7f1-cfe106cb1589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:19.999656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2cbf1-6cc8-413c-b7f1-cfe106cb1589 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:19.999934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2cbf1-6cc8-413c-b7f1-cfe106cb1589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.000208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2cbf1-6cc8-413c-b7f1-cfe106cb1589 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.000486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483fba9-f382-472a-a0a1-ff81d9daef40 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.000975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2cbf1-6cc8-413c-b7f1-cfe106cb1589 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.001376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2cbf1-6cc8-413c-b7f1-cfe106cb1589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.003314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2cbf1-6cc8-413c-b7f1-cfe106cb1589 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.020524 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 247/488] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.020524 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b829b-fa09-41f5-9600-22bae5ca8b4c None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.020524 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b829b-fa09-41f5-9600-22bae5ca8b4c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.020524 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b829b-fa09-41f5-9600-22bae5ca8b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.023820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-0483fba9-f382-472a-a0a1-ff81d9daef40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:20.025504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 242/489] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.026565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483fba9-f382-472a-a0a1-ff81d9daef40 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.038828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-4c0b829b-fa09-41f5-9600-22bae5ca8b4c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:20.040313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4c0b829b-fa09-41f5-9600-22bae5ca8b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:20.041212 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483fba9-f382-472a-a0a1-ff81d9daef40 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.046180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c711ce-3861-4516-896d-48e41a29e46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.047179 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c711ce-3861-4516-896d-48e41a29e46d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.047463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c711ce-3861-4516-896d-48e41a29e46d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.047739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c711ce-3861-4516-896d-48e41a29e46d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.049314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 248/490] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:20.056898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b829b-fa09-41f5-9600-22bae5ca8b4c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.060332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c711ce-3861-4516-896d-48e41a29e46d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.065786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c711ce-3861-4516-896d-48e41a29e46d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.071088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b829b-fa09-41f5-9600-22bae5ca8b4c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.079543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-27c711ce-3861-4516-896d-48e41a29e46d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:20.081011 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 243/491] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.081376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f322e0-0f13-491c-93a7-7c025a12bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.082411 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f322e0-0f13-491c-93a7-7c025a12bbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.082928 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f322e0-0f13-491c-93a7-7c025a12bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.083390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f322e0-0f13-491c-93a7-7c025a12bbb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.084312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f322e0-0f13-491c-93a7-7c025a12bbb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.084851 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f322e0-0f13-491c-93a7-7c025a12bbb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.086726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f322e0-0f13-491c-93a7-7c025a12bbb6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.086937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c711ce-3861-4516-896d-48e41a29e46d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.096570 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c711ce-3861-4516-896d-48e41a29e46d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.101491 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73797ef5-48e2-4723-80db-afe8f3b6404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.102178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73797ef5-48e2-4723-80db-afe8f3b6404b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.102460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73797ef5-48e2-4723-80db-afe8f3b6404b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.102732 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73797ef5-48e2-4723-80db-afe8f3b6404b admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.104109 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73797ef5-48e2-4723-80db-afe8f3b6404b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.104109 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73797ef5-48e2-4723-80db-afe8f3b6404b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.106002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73797ef5-48e2-4723-80db-afe8f3b6404b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.108315 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 249/492] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.109421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f322e0-0f13-491c-93a7-7c025a12bbb6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.118566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 244/493] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.119385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73797ef5-48e2-4723-80db-afe8f3b6404b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.120536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f322e0-0f13-491c-93a7-7c025a12bbb6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.129453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112029d-d87d-4848-861f-31b40ba487f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.130289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112029d-d87d-4848-861f-31b40ba487f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.131034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112029d-d87d-4848-861f-31b40ba487f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.131034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112029d-d87d-4848-861f-31b40ba487f7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.134858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73797ef5-48e2-4723-80db-afe8f3b6404b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.139733 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f21c-22ed-4cff-9f97-da34b327644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.140834 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f21c-22ed-4cff-9f97-da34b327644c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.141310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f21c-22ed-4cff-9f97-da34b327644c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.141811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f21c-22ed-4cff-9f97-da34b327644c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.142153 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112029d-d87d-4848-861f-31b40ba487f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:20.149367 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-7112029d-d87d-4848-861f-31b40ba487f7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:20.150312 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699f21c-22ed-4cff-9f97-da34b327644c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.150509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 250/494] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.151267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112029d-d87d-4848-861f-31b40ba487f7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.153145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699f21c-22ed-4cff-9f97-da34b327644c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.161511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112029d-d87d-4848-861f-31b40ba487f7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.166481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf8992-5ade-4306-8cc2-cf896e0a4402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.167261 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf8992-5ade-4306-8cc2-cf896e0a4402 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.167543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf8992-5ade-4306-8cc2-cf896e0a4402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.167818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf8992-5ade-4306-8cc2-cf896e0a4402 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.171038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-f699f21c-22ed-4cff-9f97-da34b327644c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:24:20.172865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 245/495] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.174117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f21c-22ed-4cff-9f97-da34b327644c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.175607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf8992-5ade-4306-8cc2-cf896e0a4402 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.177684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf8992-5ade-4306-8cc2-cf896e0a4402 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.188413 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f21c-22ed-4cff-9f97-da34b327644c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.192617 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-83cf8992-5ade-4306-8cc2-cf896e0a4402 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 13:24:20.193389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30351ec3-b274-41ea-abb3-5281730548e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.193891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 251/496] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/users/glance => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.194561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30351ec3-b274-41ea-abb3-5281730548e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.194665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf8992-5ade-4306-8cc2-cf896e0a4402 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.195139 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30351ec3-b274-41ea-abb3-5281730548e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.195631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30351ec3-b274-41ea-abb3-5281730548e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.196632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30351ec3-b274-41ea-abb3-5281730548e2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.197153 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30351ec3-b274-41ea-abb3-5281730548e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.199054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30351ec3-b274-41ea-abb3-5281730548e2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.208850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf8992-5ade-4306-8cc2-cf896e0a4402 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.210024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 246/497] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.211078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30351ec3-b274-41ea-abb3-5281730548e2 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.213405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb187de-ee29-4968-8e74-693c7ba13493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.214084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb187de-ee29-4968-8e74-693c7ba13493 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.214364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb187de-ee29-4968-8e74-693c7ba13493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.214636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb187de-ee29-4968-8e74-693c7ba13493 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.215577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb187de-ee29-4968-8e74-693c7ba13493 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.215884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb187de-ee29-4968-8e74-693c7ba13493 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.216875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-dbb187de-ee29-4968-8e74-693c7ba13493 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:20.216875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:24:20.216875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:24:20.218012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb187de-ee29-4968-8e74-693c7ba13493 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.223462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30351ec3-b274-41ea-abb3-5281730548e2 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.229034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5732fb-422e-43be-90e4-01b0aa1ae62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.230049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5732fb-422e-43be-90e4-01b0aa1ae62b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.230558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5732fb-422e-43be-90e4-01b0aa1ae62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.231170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5732fb-422e-43be-90e4-01b0aa1ae62b admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.232694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5732fb-422e-43be-90e4-01b0aa1ae62b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.233351 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5732fb-422e-43be-90e4-01b0aa1ae62b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.234700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-fe5732fb-422e-43be-90e4-01b0aa1ae62b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:20.234700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:24:20.234700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:24:20.236228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5732fb-422e-43be-90e4-01b0aa1ae62b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.262767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 252/498] 10.222.0.83 () {56 vars in 1154 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.264515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb187de-ee29-4968-8e74-693c7ba13493 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.277058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 247/499] 10.222.0.83 () {56 vars in 1158 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.278255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb187de-ee29-4968-8e74-693c7ba13493 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.278515 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5732fb-422e-43be-90e4-01b0aa1ae62b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.284052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6007fe-aea6-4343-8cf8-1f9359b581ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.285143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6007fe-aea6-4343-8cf8-1f9359b581ed admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.285868 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6007fe-aea6-4343-8cf8-1f9359b581ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.285868 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6007fe-aea6-4343-8cf8-1f9359b581ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.290368 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5732fb-422e-43be-90e4-01b0aa1ae62b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.295843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29633a90-714e-456a-a600-4fe4961f60c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.296818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29633a90-714e-456a-a600-4fe4961f60c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.297351 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29633a90-714e-456a-a600-4fe4961f60c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.297839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29633a90-714e-456a-a600-4fe4961f60c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.299350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6007fe-aea6-4343-8cf8-1f9359b581ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.301280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6007fe-aea6-4343-8cf8-1f9359b581ed admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.309076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29633a90-714e-456a-a600-4fe4961f60c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.311411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29633a90-714e-456a-a600-4fe4961f60c8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.318787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-0b6007fe-aea6-4343-8cf8-1f9359b581ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:20.320362 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 253/500] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.321284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6007fe-aea6-4343-8cf8-1f9359b581ed admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.322027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 248/501] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:20.324144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caa1eb-2eab-4b98-b86c-9a0f14bf4e02 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.324625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caa1eb-2eab-4b98-b86c-9a0f14bf4e02 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.325038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caa1eb-2eab-4b98-b86c-9a0f14bf4e02 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.327171 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 249/502] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:20.327997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caa1eb-2eab-4b98-b86c-9a0f14bf4e02 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.332535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6007fe-aea6-4343-8cf8-1f9359b581ed admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.337411 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a18a3e-3588-4c22-9901-8c0bae767a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.338074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a18a3e-3588-4c22-9901-8c0bae767a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.338356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a18a3e-3588-4c22-9901-8c0bae767a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.338629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a18a3e-3588-4c22-9901-8c0bae767a78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.341103 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caa1eb-2eab-4b98-b86c-9a0f14bf4e02 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.345783 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c1f14-b101-4959-95b0-bbaa1979eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.346691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c1f14-b101-4959-95b0-bbaa1979eba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.346796 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a18a3e-3588-4c22-9901-8c0bae767a78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.347122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c1f14-b101-4959-95b0-bbaa1979eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.347519 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c1f14-b101-4959-95b0-bbaa1979eba2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.348703 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a18a3e-3588-4c22-9901-8c0bae767a78 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.358339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 254/503] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:20.359241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a18a3e-3588-4c22-9901-8c0bae767a78 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.360355 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c1f14-b101-4959-95b0-bbaa1979eba2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.362215 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c1f14-b101-4959-95b0-bbaa1979eba2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.368218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a18a3e-3588-4c22-9901-8c0bae767a78 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.372830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559300b-9b00-439b-9045-f2bc790a7377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.373561 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559300b-9b00-439b-9045-f2bc790a7377 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.373937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559300b-9b00-439b-9045-f2bc790a7377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.374281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559300b-9b00-439b-9045-f2bc790a7377 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.375076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559300b-9b00-439b-9045-f2bc790a7377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.375453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559300b-9b00-439b-9045-f2bc790a7377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.377065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559300b-9b00-439b-9045-f2bc790a7377 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.378971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-b41c1f14-b101-4959-95b0-bbaa1979eba2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:20.384990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 250/504] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.384990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ac9d7-dd19-42e1-9551-fb22bd3fbcbf None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.384990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ac9d7-dd19-42e1-9551-fb22bd3fbcbf None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.384990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ac9d7-dd19-42e1-9551-fb22bd3fbcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.388966 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 255/505] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.389986 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559300b-9b00-439b-9045-f2bc790a7377 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.403449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559300b-9b00-439b-9045-f2bc790a7377 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.406068 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-bd6ac9d7-dd19-42e1-9551-fb22bd3fbcbf None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:20.407303 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-bd6ac9d7-dd19-42e1-9551-fb22bd3fbcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:20.408059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbf993-67bc-4fad-8918-568bbd6b1d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.408901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbf993-67bc-4fad-8918-568bbd6b1d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.409250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbf993-67bc-4fad-8918-568bbd6b1d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.409592 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbf993-67bc-4fad-8918-568bbd6b1d13 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.415853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 251/506] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:20.418286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ac9d7-dd19-42e1-9551-fb22bd3fbcbf None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.424231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbf993-67bc-4fad-8918-568bbd6b1d13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.426431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbf993-67bc-4fad-8918-568bbd6b1d13 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.428141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ac9d7-dd19-42e1-9551-fb22bd3fbcbf None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.432531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca8ea-2a26-49cb-82f3-594e9102c236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.433173 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca8ea-2a26-49cb-82f3-594e9102c236 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.433453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca8ea-2a26-49cb-82f3-594e9102c236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.434017 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca8ea-2a26-49cb-82f3-594e9102c236 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.434959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ca8ea-2a26-49cb-82f3-594e9102c236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.435066 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ca8ea-2a26-49cb-82f3-594e9102c236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.436617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ca8ea-2a26-49cb-82f3-594e9102c236 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.445667 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-02fbf993-67bc-4fad-8918-568bbd6b1d13 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:20.447093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 256/507] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.448128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbf993-67bc-4fad-8918-568bbd6b1d13 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.449416 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 252/508] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.449416 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca8ea-2a26-49cb-82f3-594e9102c236 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.461922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca8ea-2a26-49cb-82f3-594e9102c236 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.462474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbf993-67bc-4fad-8918-568bbd6b1d13 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.466306 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610b95f-7ae9-49fb-80ef-0dc4939badf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.466863 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5a481-a939-4623-beb6-307ad4047e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.467214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b95f-7ae9-49fb-80ef-0dc4939badf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.467580 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b95f-7ae9-49fb-80ef-0dc4939badf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.467828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5a481-a939-4623-beb6-307ad4047e4f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.467929 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b95f-7ae9-49fb-80ef-0dc4939badf7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.468226 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5a481-a939-4623-beb6-307ad4047e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.468557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5a481-a939-4623-beb6-307ad4047e4f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.479118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610b95f-7ae9-49fb-80ef-0dc4939badf7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:20.479413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5a481-a939-4623-beb6-307ad4047e4f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.482551 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5a481-a939-4623-beb6-307ad4047e4f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.486268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-1610b95f-7ae9-49fb-80ef-0dc4939badf7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:20.487692 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 253/509] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.488473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610b95f-7ae9-49fb-80ef-0dc4939badf7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.496595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-78d5a481-a939-4623-beb6-307ad4047e4f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 13:24:20.497787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 257/510] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.498523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5a481-a939-4623-beb6-307ad4047e4f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.498636 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610b95f-7ae9-49fb-80ef-0dc4939badf7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.503425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aed03-9eee-408a-9004-fabf8c6db482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.504082 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aed03-9eee-408a-9004-fabf8c6db482 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.504366 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aed03-9eee-408a-9004-fabf8c6db482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.504638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aed03-9eee-408a-9004-fabf8c6db482 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.505384 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9aed03-9eee-408a-9004-fabf8c6db482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.505688 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9aed03-9eee-408a-9004-fabf8c6db482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.507391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9aed03-9eee-408a-9004-fabf8c6db482 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.508483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5a481-a939-4623-beb6-307ad4047e4f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.512958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067678d-b8e7-4e6e-97c8-46588593b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.513725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067678d-b8e7-4e6e-97c8-46588593b71a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.514040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067678d-b8e7-4e6e-97c8-46588593b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.514304 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067678d-b8e7-4e6e-97c8-46588593b71a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.519643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 254/511] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.525003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aed03-9eee-408a-9004-fabf8c6db482 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.526522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067678d-b8e7-4e6e-97c8-46588593b71a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.528529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067678d-b8e7-4e6e-97c8-46588593b71a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.534219 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aed03-9eee-408a-9004-fabf8c6db482 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.539110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e57d0-278a-4ddd-915f-3472f52e95e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.539756 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e57d0-278a-4ddd-915f-3472f52e95e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.540037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e57d0-278a-4ddd-915f-3472f52e95e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.540310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e57d0-278a-4ddd-915f-3472f52e95e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.541059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e57d0-278a-4ddd-915f-3472f52e95e5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.541363 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e57d0-278a-4ddd-915f-3472f52e95e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.542978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e57d0-278a-4ddd-915f-3472f52e95e5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.543709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-2067678d-b8e7-4e6e-97c8-46588593b71a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:20.545095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 258/512] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.545736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067678d-b8e7-4e6e-97c8-46588593b71a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.555323 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067678d-b8e7-4e6e-97c8-46588593b71a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.561050 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 255/513] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.561050 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e57d0-278a-4ddd-915f-3472f52e95e5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.565073 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a2b74-b85d-48cd-9ff6-27096f2c5229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.565823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2b74-b85d-48cd-9ff6-27096f2c5229 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.566168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2b74-b85d-48cd-9ff6-27096f2c5229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.566334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e57d0-278a-4ddd-915f-3472f52e95e5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.566567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2b74-b85d-48cd-9ff6-27096f2c5229 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.567462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a2b74-b85d-48cd-9ff6-27096f2c5229 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.567838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a2b74-b85d-48cd-9ff6-27096f2c5229 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.569774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a2b74-b85d-48cd-9ff6-27096f2c5229 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.570718 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c80330-3c75-4179-b0e8-6836deacebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.571488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c80330-3c75-4179-b0e8-6836deacebce admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.571769 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c80330-3c75-4179-b0e8-6836deacebce admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.572043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c80330-3c75-4179-b0e8-6836deacebce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.578838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c80330-3c75-4179-b0e8-6836deacebce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.580786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c80330-3c75-4179-b0e8-6836deacebce admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.593098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 259/514] 10.222.0.83 () {56 vars in 1158 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.593098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a2b74-b85d-48cd-9ff6-27096f2c5229 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.594885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-74c80330-3c75-4179-b0e8-6836deacebce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:20.596160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 256/515] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.601744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c80330-3c75-4179-b0e8-6836deacebce admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.606850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a2b74-b85d-48cd-9ff6-27096f2c5229 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.610806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c80330-3c75-4179-b0e8-6836deacebce admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.611334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dcbf0-30bd-41ca-b22e-7d721558083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.612060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dcbf0-30bd-41ca-b22e-7d721558083f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.612404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dcbf0-30bd-41ca-b22e-7d721558083f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.612746 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dcbf0-30bd-41ca-b22e-7d721558083f admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.613614 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207dcbf0-30bd-41ca-b22e-7d721558083f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.614024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207dcbf0-30bd-41ca-b22e-7d721558083f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.615123 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-207dcbf0-30bd-41ca-b22e-7d721558083f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:20.615123 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:24:20.615123 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:24:20.615779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd68a8a-249d-4eea-97bf-e41b43ffbd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.616497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207dcbf0-30bd-41ca-b22e-7d721558083f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.616684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd68a8a-249d-4eea-97bf-e41b43ffbd10 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.617024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd68a8a-249d-4eea-97bf-e41b43ffbd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.617356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd68a8a-249d-4eea-97bf-e41b43ffbd10 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.636349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd68a8a-249d-4eea-97bf-e41b43ffbd10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.638227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 260/516] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.638970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dcbf0-30bd-41ca-b22e-7d721558083f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.642118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd68a8a-249d-4eea-97bf-e41b43ffbd10 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.650504 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dcbf0-30bd-41ca-b22e-7d721558083f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.656983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed1dce-6e6c-4149-860d-7904be1d148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.657268 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed1dce-6e6c-4149-860d-7904be1d148d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.657554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed1dce-6e6c-4149-860d-7904be1d148d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.657860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed1dce-6e6c-4149-860d-7904be1d148d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.666277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed1dce-6e6c-4149-860d-7904be1d148d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.667972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed1dce-6e6c-4149-860d-7904be1d148d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.668985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-cfd68a8a-249d-4eea-97bf-e41b43ffbd10 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:20.675731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 257/517] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.675731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd68a8a-249d-4eea-97bf-e41b43ffbd10 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.681129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 261/518] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:20.685938 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed1dce-6e6c-4149-860d-7904be1d148d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.687377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd68a8a-249d-4eea-97bf-e41b43ffbd10 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.696503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed1dce-6e6c-4149-860d-7904be1d148d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.696829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70b1e0-4ddf-4961-be5a-dbe4eb2292a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.697817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70b1e0-4ddf-4961-be5a-dbe4eb2292a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.698289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70b1e0-4ddf-4961-be5a-dbe4eb2292a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.698716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70b1e0-4ddf-4961-be5a-dbe4eb2292a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.700024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70b1e0-4ddf-4961-be5a-dbe4eb2292a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.700590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70b1e0-4ddf-4961-be5a-dbe4eb2292a6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.702198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-0f70b1e0-4ddf-4961-be5a-dbe4eb2292a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:20.702198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:24:20.702198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:24:20.703705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70b1e0-4ddf-4961-be5a-dbe4eb2292a6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.710254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea8563-019d-417a-9a8e-79986fc05bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.710735 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea8563-019d-417a-9a8e-79986fc05bda admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.711049 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea8563-019d-417a-9a8e-79986fc05bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.711330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea8563-019d-417a-9a8e-79986fc05bda admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.712207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea8563-019d-417a-9a8e-79986fc05bda admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=a34b3d2f67b1477598acce389819c70a) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.712521 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea8563-019d-417a-9a8e-79986fc05bda admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.715121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea8563-019d-417a-9a8e-79986fc05bda admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.721573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 262/519] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/role_assignments?user.id=a34b3d2f67b1477598acce389819c70a&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.722558 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea8563-019d-417a-9a8e-79986fc05bda admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.732811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea8563-019d-417a-9a8e-79986fc05bda admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.738342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe87dde-b59b-490f-9c82-519f76c0a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.739032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe87dde-b59b-490f-9c82-519f76c0a8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.739311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe87dde-b59b-490f-9c82-519f76c0a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.739581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe87dde-b59b-490f-9c82-519f76c0a8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.740383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe87dde-b59b-490f-9c82-519f76c0a8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.740685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe87dde-b59b-490f-9c82-519f76c0a8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.741737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 258/520] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.748011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe87dde-b59b-490f-9c82-519f76c0a8e0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.748093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70b1e0-4ddf-4961-be5a-dbe4eb2292a6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.765823 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70b1e0-4ddf-4961-be5a-dbe4eb2292a6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.766967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 263/521] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.767701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe87dde-b59b-490f-9c82-519f76c0a8e0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.771773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6932af-ffed-4710-9f99-d09c059faf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.773483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6932af-ffed-4710-9f99-d09c059faf5f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.774281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6932af-ffed-4710-9f99-d09c059faf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.774755 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6932af-ffed-4710-9f99-d09c059faf5f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.778969 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe87dde-b59b-490f-9c82-519f76c0a8e0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.783933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731100e-c1e4-4c75-8cb2-ae1ba069ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.784921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731100e-c1e4-4c75-8cb2-ae1ba069ad3d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.784921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731100e-c1e4-4c75-8cb2-ae1ba069ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.785191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731100e-c1e4-4c75-8cb2-ae1ba069ad3d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.786118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731100e-c1e4-4c75-8cb2-ae1ba069ad3d admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=80ddafedf2734326832ab4bf620f7634) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.786429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731100e-c1e4-4c75-8cb2-ae1ba069ad3d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.788506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731100e-c1e4-4c75-8cb2-ae1ba069ad3d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.790412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6932af-ffed-4710-9f99-d09c059faf5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.793546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6932af-ffed-4710-9f99-d09c059faf5f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.795098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 264/522] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/role_assignments?user.id=80ddafedf2734326832ab4bf620f7634&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.796061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731100e-c1e4-4c75-8cb2-ae1ba069ad3d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.806998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731100e-c1e4-4c75-8cb2-ae1ba069ad3d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.812146 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8f3e3-1372-4136-93b5-426d8593850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.813179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8f3e3-1372-4136-93b5-426d8593850a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.813534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8f3e3-1372-4136-93b5-426d8593850a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.813962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8f3e3-1372-4136-93b5-426d8593850a admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.816680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-ed6932af-ffed-4710-9f99-d09c059faf5f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:20.824235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 259/523] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.826418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6932af-ffed-4710-9f99-d09c059faf5f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.826557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8f3e3-1372-4136-93b5-426d8593850a admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.828978 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8f3e3-1372-4136-93b5-426d8593850a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.839291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6932af-ffed-4710-9f99-d09c059faf5f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.844324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ec206-427c-4774-be7b-7dad53fe3a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.845213 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-2ce8f3e3-1372-4136-93b5-426d8593850a admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 13:24:20.845573 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ec206-427c-4774-be7b-7dad53fe3a29 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.846083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ec206-427c-4774-be7b-7dad53fe3a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.846577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ec206-427c-4774-be7b-7dad53fe3a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.846832 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 265/524] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.847722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ec206-427c-4774-be7b-7dad53fe3a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.850268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ec206-427c-4774-be7b-7dad53fe3a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.852343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ec206-427c-4774-be7b-7dad53fe3a29 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.855137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8f3e3-1372-4136-93b5-426d8593850a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.866085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 260/525] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:20.871872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ec206-427c-4774-be7b-7dad53fe3a29 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.872610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8f3e3-1372-4136-93b5-426d8593850a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.883397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf68f32-5faf-44e8-bf47-c2ec85c451db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.884223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf68f32-5faf-44e8-bf47-c2ec85c451db admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.884604 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf68f32-5faf-44e8-bf47-c2ec85c451db admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.884981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf68f32-5faf-44e8-bf47-c2ec85c451db admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.885291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ec206-427c-4774-be7b-7dad53fe3a29 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.886067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf68f32-5faf-44e8-bf47-c2ec85c451db admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.886467 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf68f32-5faf-44e8-bf47-c2ec85c451db admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.888388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf68f32-5faf-44e8-bf47-c2ec85c451db admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.890932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad46891-410c-4fcf-a5f1-a522d25a9328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.892818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46891-410c-4fcf-a5f1-a522d25a9328 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.893251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46891-410c-4fcf-a5f1-a522d25a9328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.893696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46891-410c-4fcf-a5f1-a522d25a9328 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.902623 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad46891-410c-4fcf-a5f1-a522d25a9328 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.904910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad46891-410c-4fcf-a5f1-a522d25a9328 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.911884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 266/526] 10.222.0.83 () {56 vars in 1160 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.919466 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf68f32-5faf-44e8-bf47-c2ec85c451db admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.922092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-6ad46891-410c-4fcf-a5f1-a522d25a9328 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:20.923719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 261/527] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:20.929834 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad46891-410c-4fcf-a5f1-a522d25a9328 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.931575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf68f32-5faf-44e8-bf47-c2ec85c451db admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.936681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e803b80-9af4-4a43-bfb8-cb2b5215916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.937625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e803b80-9af4-4a43-bfb8-cb2b5215916d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.938069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e803b80-9af4-4a43-bfb8-cb2b5215916d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.938479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e803b80-9af4-4a43-bfb8-cb2b5215916d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.941563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad46891-410c-4fcf-a5f1-a522d25a9328 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.947596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61217d-c8a0-4b42-864b-394da081cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.948413 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61217d-c8a0-4b42-864b-394da081cabe admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.948817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61217d-c8a0-4b42-864b-394da081cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.949185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61217d-c8a0-4b42-864b-394da081cabe admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.949731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e803b80-9af4-4a43-bfb8-cb2b5215916d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.950339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61217d-c8a0-4b42-864b-394da081cabe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.950740 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61217d-c8a0-4b42-864b-394da081cabe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.952020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e803b80-9af4-4a43-bfb8-cb2b5215916d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.952962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61217d-c8a0-4b42-864b-394da081cabe admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:20.963132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 267/528] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:24:20.967551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 262/529] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:20.969600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e803b80-9af4-4a43-bfb8-cb2b5215916d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.973851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61217d-c8a0-4b42-864b-394da081cabe admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:20.979646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e803b80-9af4-4a43-bfb8-cb2b5215916d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.984439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf25f6-9984-4b2f-80c3-69ee7129b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.984928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61217d-c8a0-4b42-864b-394da081cabe admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:20.985681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf25f6-9984-4b2f-80c3-69ee7129b348 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.986199 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf25f6-9984-4b2f-80c3-69ee7129b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.986689 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf25f6-9984-4b2f-80c3-69ee7129b348 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.990300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212135f7-084a-43c3-85ef-d988d6de1df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:20.991691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212135f7-084a-43c3-85ef-d988d6de1df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:20.992066 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212135f7-084a-43c3-85ef-d988d6de1df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:20.992439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212135f7-084a-43c3-85ef-d988d6de1df8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:20.993446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212135f7-084a-43c3-85ef-d988d6de1df8 admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=63a5db2990424915ac1daf36d14a733b) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:20.993944 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212135f7-084a-43c3-85ef-d988d6de1df8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:20.996087 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212135f7-084a-43c3-85ef-d988d6de1df8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:21.001495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf25f6-9984-4b2f-80c3-69ee7129b348 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:21.002695 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 263/530] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/role_assignments?user.id=63a5db2990424915ac1daf36d14a733b&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:21.003784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf25f6-9984-4b2f-80c3-69ee7129b348 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:21.026342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-e6cf25f6-9984-4b2f-80c3-69ee7129b348 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:21.028330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 268/531] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:21.034818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212135f7-084a-43c3-85ef-d988d6de1df8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:21.048022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212135f7-084a-43c3-85ef-d988d6de1df8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:21.052931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78732b95-43a8-4b73-b11f-11b51605bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:21.054301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78732b95-43a8-4b73-b11f-11b51605bbec admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:21.054629 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78732b95-43a8-4b73-b11f-11b51605bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:21.054973 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78732b95-43a8-4b73-b11f-11b51605bbec admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:21.055810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78732b95-43a8-4b73-b11f-11b51605bbec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:21.056186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78732b95-43a8-4b73-b11f-11b51605bbec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:21.057962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78732b95-43a8-4b73-b11f-11b51605bbec admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:21.073135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 264/532] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:21.079490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf25f6-9984-4b2f-80c3-69ee7129b348 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:21.090924 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf25f6-9984-4b2f-80c3-69ee7129b348 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:21.096233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7685f56-e856-4b5a-98bf-2bc2adb8e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:21.097453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7685f56-e856-4b5a-98bf-2bc2adb8e800 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:21.097988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7685f56-e856-4b5a-98bf-2bc2adb8e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:21.098500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7685f56-e856-4b5a-98bf-2bc2adb8e800 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:21.107733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7685f56-e856-4b5a-98bf-2bc2adb8e800 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:21.110382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7685f56-e856-4b5a-98bf-2bc2adb8e800 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:21.127170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-e7685f56-e856-4b5a-98bf-2bc2adb8e800 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:21.128421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 269/533] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:21.136435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78732b95-43a8-4b73-b11f-11b51605bbec admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:21.154625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f2316-9caa-49e2-8211-35d5a87c1947 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:21.155026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f2316-9caa-49e2-8211-35d5a87c1947 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:21.155185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f2316-9caa-49e2-8211-35d5a87c1947 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:21.155500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78732b95-43a8-4b73-b11f-11b51605bbec admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:21.156979 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 270/534] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:21.163637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a73f78-27f2-4b03-9fad-3b8c9f1055bc None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:21.163955 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a73f78-27f2-4b03-9fad-3b8c9f1055bc None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:21.164193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a73f78-27f2-4b03-9fad-3b8c9f1055bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:21.165779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae61177-bd6b-4733-aafb-6c558603cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:21.166574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae61177-bd6b-4733-aafb-6c558603cf47 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:21.166935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae61177-bd6b-4733-aafb-6c558603cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:21.167275 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae61177-bd6b-4733-aafb-6c558603cf47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:21.168187 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae61177-bd6b-4733-aafb-6c558603cf47 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:21.168576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae61177-bd6b-4733-aafb-6c558603cf47 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:21.170700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae61177-bd6b-4733-aafb-6c558603cf47 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:21.196832 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 265/535] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:21.203779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae61177-bd6b-4733-aafb-6c558603cf47 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:21.204702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-b0a73f78-27f2-4b03-9fad-3b8c9f1055bc None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:21.206469 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b0a73f78-27f2-4b03-9fad-3b8c9f1055bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:21.216882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae61177-bd6b-4733-aafb-6c558603cf47 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:21.218599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 271/536] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:21.224545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdc153-3fad-4787-a452-72f7e4908ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:21.224837 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdc153-3fad-4787-a452-72f7e4908ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:21.225096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdc153-3fad-4787-a452-72f7e4908ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:21.225412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdc153-3fad-4787-a452-72f7e4908ae6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:21.226302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdc153-3fad-4787-a452-72f7e4908ae6 admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=de1632f6a5414d2abfdee3b5bdd941cd) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:21.226609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdc153-3fad-4787-a452-72f7e4908ae6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:21.228520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdc153-3fad-4787-a452-72f7e4908ae6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:21.236004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 266/537] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:21 2021] GET /identity/v3/role_assignments?user.id=de1632f6a5414d2abfdee3b5bdd941cd&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:21.255390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a73f78-27f2-4b03-9fad-3b8c9f1055bc None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:21.271495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a73f78-27f2-4b03-9fad-3b8c9f1055bc None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:21.276457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5a36c-0e1e-4321-8e6e-b83bd41e9264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:21.277475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5a36c-0e1e-4321-8e6e-b83bd41e9264 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:21.277959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5a36c-0e1e-4321-8e6e-b83bd41e9264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:21.278380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5a36c-0e1e-4321-8e6e-b83bd41e9264 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:21.296116 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5a36c-0e1e-4321-8e6e-b83bd41e9264 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:21.298167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5a36c-0e1e-4321-8e6e-b83bd41e9264 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:21.321276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-f4a5a36c-0e1e-4321-8e6e-b83bd41e9264 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:21.322576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 272/538] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:21.330370 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdc153-3fad-4787-a452-72f7e4908ae6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:21.340891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdc153-3fad-4787-a452-72f7e4908ae6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:21.345733 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721195c5-b9ca-4b19-9947-efd927fa7f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:21.346489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721195c5-b9ca-4b19-9947-efd927fa7f2d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:21.346774 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721195c5-b9ca-4b19-9947-efd927fa7f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:21.347054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721195c5-b9ca-4b19-9947-efd927fa7f2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:21.347870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721195c5-b9ca-4b19-9947-efd927fa7f2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:21.348180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721195c5-b9ca-4b19-9947-efd927fa7f2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:21.350029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721195c5-b9ca-4b19-9947-efd927fa7f2d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:21.369878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 267/539] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:21.372406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5a36c-0e1e-4321-8e6e-b83bd41e9264 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:21.383662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5a36c-0e1e-4321-8e6e-b83bd41e9264 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:21.388462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323710f8-e9b1-41b8-9c23-9b3fbae84ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:21.389221 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323710f8-e9b1-41b8-9c23-9b3fbae84ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:21.389511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323710f8-e9b1-41b8-9c23-9b3fbae84ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:21.389815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323710f8-e9b1-41b8-9c23-9b3fbae84ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:21.390749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323710f8-e9b1-41b8-9c23-9b3fbae84ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:21.392820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323710f8-e9b1-41b8-9c23-9b3fbae84ca1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:21.438363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 273/540] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:24:21 2021] POST /identity/v3/users => generated 247 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:23.704051 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bcb6f-7a1b-47a5-a6b2-201337ce1bef None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:23.704579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bcb6f-7a1b-47a5-a6b2-201337ce1bef None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:23.704579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bcb6f-7a1b-47a5-a6b2-201337ce1bef None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:23.706694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 268/541] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:23.715801 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012018a0-3589-4ace-8ce6-f6195484e1e4 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:23.716280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012018a0-3589-4ace-8ce6-f6195484e1e4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:23.716552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012018a0-3589-4ace-8ce6-f6195484e1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:23.746774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-012018a0-3589-4ace-8ce6-f6195484e1e4 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:23.747976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-012018a0-3589-4ace-8ce6-f6195484e1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:23.756101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 274/542] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:23.787713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bcb6f-7a1b-47a5-a6b2-201337ce1bef None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:23.803741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bcb6f-7a1b-47a5-a6b2-201337ce1bef None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:23.809171 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79ccaf-6d77-469c-a296-679b2628d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:23.809986 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79ccaf-6d77-469c-a296-679b2628d47b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:23.810264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79ccaf-6d77-469c-a296-679b2628d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:23.810531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79ccaf-6d77-469c-a296-679b2628d47b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:23.826661 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79ccaf-6d77-469c-a296-679b2628d47b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:23.833617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-6e79ccaf-6d77-469c-a296-679b2628d47b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:23.835601 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 269/543] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:23.841684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012018a0-3589-4ace-8ce6-f6195484e1e4 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:23.854896 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012018a0-3589-4ace-8ce6-f6195484e1e4 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:23.859513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f2d25-e911-459a-83af-7b871fae90db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:23.860180 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2d25-e911-459a-83af-7b871fae90db admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:23.860456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2d25-e911-459a-83af-7b871fae90db admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:23.860726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2d25-e911-459a-83af-7b871fae90db admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:23.861483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f2d25-e911-459a-83af-7b871fae90db admin admin] RBAC: Adding query filter params (name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:23.861809 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f2d25-e911-459a-83af-7b871fae90db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:23.863384 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f2d25-e911-459a-83af-7b871fae90db admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:23.872145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 275/544] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:23.878071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79ccaf-6d77-469c-a296-679b2628d47b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:23.888361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79ccaf-6d77-469c-a296-679b2628d47b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:23.898549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68584e-077a-4561-b0e1-9e8571a7674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:23.899349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68584e-077a-4561-b0e1-9e8571a7674e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:23.899622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68584e-077a-4561-b0e1-9e8571a7674e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:23.899887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68584e-077a-4561-b0e1-9e8571a7674e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:23.912117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ba704-75e3-4d91-b3b4-8cf6384968a3 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:23.912365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ba704-75e3-4d91-b3b4-8cf6384968a3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:23.912586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ba704-75e3-4d91-b3b4-8cf6384968a3 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:23.914659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 276/545] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:23.919033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68584e-077a-4561-b0e1-9e8571a7674e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:23.921050 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68584e-077a-4561-b0e1-9e8571a7674e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:23.921531 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c472b-115c-406d-a97b-7bc611cce6a8 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:23.921843 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c472b-115c-406d-a97b-7bc611cce6a8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:23.922126 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c472b-115c-406d-a97b-7bc611cce6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:23.950817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-3a1c472b-115c-406d-a97b-7bc611cce6a8 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:23.952339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3a1c472b-115c-406d-a97b-7bc611cce6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:23.954662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-4f68584e-077a-4561-b0e1-9e8571a7674e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:23.955886 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 270/546] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:23.962169 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 277/547] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:23.962549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68584e-077a-4561-b0e1-9e8571a7674e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:23.978620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68584e-077a-4561-b0e1-9e8571a7674e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:23.987790 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5f0fa-402c-4ef0-a4ac-d9b9df89e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:23.988657 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f0fa-402c-4ef0-a4ac-d9b9df89e24c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:23.988779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c472b-115c-406d-a97b-7bc611cce6a8 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:23.989180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f0fa-402c-4ef0-a4ac-d9b9df89e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:23.989588 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f0fa-402c-4ef0-a4ac-d9b9df89e24c admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:23.990492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5f0fa-402c-4ef0-a4ac-d9b9df89e24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:23.991483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5f0fa-402c-4ef0-a4ac-d9b9df89e24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:23.993199 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5f0fa-402c-4ef0-a4ac-d9b9df89e24c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.006453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c472b-115c-406d-a97b-7bc611cce6a8 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.015575 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 271/548] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.020356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5f0fa-402c-4ef0-a4ac-d9b9df89e24c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.026008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df1316-30e5-4d6d-9457-662805986ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.027578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1316-30e5-4d6d-9457-662805986ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.028272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1316-30e5-4d6d-9457-662805986ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.028690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1316-30e5-4d6d-9457-662805986ad9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.029992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5f0fa-402c-4ef0-a4ac-d9b9df89e24c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.037788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64baf8a-656a-4784-b4b2-0255f92e1766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.037788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64baf8a-656a-4784-b4b2-0255f92e1766 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.037788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64baf8a-656a-4784-b4b2-0255f92e1766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.037788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64baf8a-656a-4784-b4b2-0255f92e1766 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.044695 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64baf8a-656a-4784-b4b2-0255f92e1766 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.046980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64baf8a-656a-4784-b4b2-0255f92e1766 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.049545 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df1316-30e5-4d6d-9457-662805986ad9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:24.057543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-e3df1316-30e5-4d6d-9457-662805986ad9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:24.059481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 278/549] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.065490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df1316-30e5-4d6d-9457-662805986ad9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.072536 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-e64baf8a-656a-4784-b4b2-0255f92e1766 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:24:24.078096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 272/550] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.080814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64baf8a-656a-4784-b4b2-0255f92e1766 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.083743 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df1316-30e5-4d6d-9457-662805986ad9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.089599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235fd8c-f7aa-4c6b-9ce1-7b92dc74e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.090549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235fd8c-f7aa-4c6b-9ce1-7b92dc74e37b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.090791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64baf8a-656a-4784-b4b2-0255f92e1766 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.091244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235fd8c-f7aa-4c6b-9ce1-7b92dc74e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.091694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235fd8c-f7aa-4c6b-9ce1-7b92dc74e37b admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.092641 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235fd8c-f7aa-4c6b-9ce1-7b92dc74e37b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.093125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235fd8c-f7aa-4c6b-9ce1-7b92dc74e37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.094925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235fd8c-f7aa-4c6b-9ce1-7b92dc74e37b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.095684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ad0c9-1d61-4626-ac71-1447abee802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.096426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ad0c9-1d61-4626-ac71-1447abee802f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.096781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ad0c9-1d61-4626-ac71-1447abee802f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.097365 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ad0c9-1d61-4626-ac71-1447abee802f admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.098737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ad0c9-1d61-4626-ac71-1447abee802f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.099120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ad0c9-1d61-4626-ac71-1447abee802f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.101074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ad0c9-1d61-4626-ac71-1447abee802f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.106944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 279/551] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.108427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000ad72-84de-4efd-8b06-64527ab45232 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.109226 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000ad72-84de-4efd-8b06-64527ab45232 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.109684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000ad72-84de-4efd-8b06-64527ab45232 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.113557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 280/552] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:24.114543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000ad72-84de-4efd-8b06-64527ab45232 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.127692 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 273/553] 10.222.0.83 () {56 vars in 1154 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:24.130883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4770-30bb-452d-b4c6-c2c8ea659ae6 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.132893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4770-30bb-452d-b4c6-c2c8ea659ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.133170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4770-30bb-452d-b4c6-c2c8ea659ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.137521 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000ad72-84de-4efd-8b06-64527ab45232 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.143183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1791233-efbc-41cf-b8b3-38025c1e37fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.144264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791233-efbc-41cf-b8b3-38025c1e37fc admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.144749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791233-efbc-41cf-b8b3-38025c1e37fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.145231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791233-efbc-41cf-b8b3-38025c1e37fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.153054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c34c4770-30bb-452d-b4c6-c2c8ea659ae6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:24.154642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c34c4770-30bb-452d-b4c6-c2c8ea659ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:24.156722 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1791233-efbc-41cf-b8b3-38025c1e37fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.158812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1791233-efbc-41cf-b8b3-38025c1e37fc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.163373 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 274/554] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:24.164111 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c4770-30bb-452d-b4c6-c2c8ea659ae6 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.174293 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c4770-30bb-452d-b4c6-c2c8ea659ae6 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.177366 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-f1791233-efbc-41cf-b8b3-38025c1e37fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:24.179146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45b290-f785-40e6-a5a5-5a100c58e08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.179923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45b290-f785-40e6-a5a5-5a100c58e08e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.180043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 281/555] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.180200 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45b290-f785-40e6-a5a5-5a100c58e08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.180450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45b290-f785-40e6-a5a5-5a100c58e08e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.185862 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1791233-efbc-41cf-b8b3-38025c1e37fc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.198220 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1791233-efbc-41cf-b8b3-38025c1e37fc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.198486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45b290-f785-40e6-a5a5-5a100c58e08e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.200287 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45b290-f785-40e6-a5a5-5a100c58e08e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.202700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fdbe2-f0cb-4a71-8f16-4a5618df11cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.203353 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fdbe2-f0cb-4a71-8f16-4a5618df11cf admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.203637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fdbe2-f0cb-4a71-8f16-4a5618df11cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.203911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fdbe2-f0cb-4a71-8f16-4a5618df11cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.204652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fdbe2-f0cb-4a71-8f16-4a5618df11cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.204968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fdbe2-f0cb-4a71-8f16-4a5618df11cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.206613 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fdbe2-f0cb-4a71-8f16-4a5618df11cf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.217924 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 282/556] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:24.218802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-6d45b290-f785-40e6-a5a5-5a100c58e08e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:24.219178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37351932-6e2b-4c6e-a674-f43df75fdc7f None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.219462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37351932-6e2b-4c6e-a674-f43df75fdc7f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.219744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37351932-6e2b-4c6e-a674-f43df75fdc7f None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.221804 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 283/558] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:24.222266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37351932-6e2b-4c6e-a674-f43df75fdc7f None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.225870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 275/558] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.226709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45b290-f785-40e6-a5a5-5a100c58e08e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.237583 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45b290-f785-40e6-a5a5-5a100c58e08e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.239901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37351932-6e2b-4c6e-a674-f43df75fdc7f None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.243144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3a870-12d2-4326-b207-2497ba2ea9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.243931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3a870-12d2-4326-b207-2497ba2ea9ef admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.244203 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3a870-12d2-4326-b207-2497ba2ea9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.244473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3a870-12d2-4326-b207-2497ba2ea9ef admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.245234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6e34f-d03d-42d6-b803-6f8718d3c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.246040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e34f-d03d-42d6-b803-6f8718d3c1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.246325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e34f-d03d-42d6-b803-6f8718d3c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.246603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e34f-d03d-42d6-b803-6f8718d3c1e2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.252162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3a870-12d2-4326-b207-2497ba2ea9ef admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.254299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3a870-12d2-4326-b207-2497ba2ea9ef admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.258320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6e34f-d03d-42d6-b803-6f8718d3c1e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:24.265231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-00c6e34f-d03d-42d6-b803-6f8718d3c1e2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:24.266672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 284/559] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.268359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6e34f-d03d-42d6-b803-6f8718d3c1e2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.268785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-10f3a870-12d2-4326-b207-2497ba2ea9ef admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 13:24:24.269984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 276/560] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/users/glance => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.271266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e7b6-e831-427d-a5de-d6d27b1753de None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.271639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e7b6-e831-427d-a5de-d6d27b1753de None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.271918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e7b6-e831-427d-a5de-d6d27b1753de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.279774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6e34f-d03d-42d6-b803-6f8718d3c1e2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.284091 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6d65e-5d7c-4433-820b-7d423a51b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.284902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d65e-5d7c-4433-820b-7d423a51b623 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.285018 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d65e-5d7c-4433-820b-7d423a51b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.285267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d65e-5d7c-4433-820b-7d423a51b623 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.286036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6d65e-5d7c-4433-820b-7d423a51b623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.286344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6d65e-5d7c-4433-820b-7d423a51b623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.287946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6d65e-5d7c-4433-820b-7d423a51b623 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.290108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b952e7b6-e831-427d-a5de-d6d27b1753de None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:24.291292 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b952e7b6-e831-427d-a5de-d6d27b1753de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:24.299024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 277/561] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:24.299698 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952e7b6-e831-427d-a5de-d6d27b1753de None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.311215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 285/562] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.311215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6d65e-5d7c-4433-820b-7d423a51b623 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.315935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952e7b6-e831-427d-a5de-d6d27b1753de None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.322312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6d65e-5d7c-4433-820b-7d423a51b623 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.323055 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ec7c4-7243-4e46-b1eb-a5560c0db178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.323948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ec7c4-7243-4e46-b1eb-a5560c0db178 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.324228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ec7c4-7243-4e46-b1eb-a5560c0db178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.324498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ec7c4-7243-4e46-b1eb-a5560c0db178 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.325387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ec7c4-7243-4e46-b1eb-a5560c0db178 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.325687 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ec7c4-7243-4e46-b1eb-a5560c0db178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.327380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ec7c4-7243-4e46-b1eb-a5560c0db178 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.327649 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b8cb1-4d04-4339-ae08-a1bccc583eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.328600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b8cb1-4d04-4339-ae08-a1bccc583eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.328885 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b8cb1-4d04-4339-ae08-a1bccc583eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.329168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b8cb1-4d04-4339-ae08-a1bccc583eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.330190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b8cb1-4d04-4339-ae08-a1bccc583eb7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.330492 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b8cb1-4d04-4339-ae08-a1bccc583eb7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.332499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b8cb1-4d04-4339-ae08-a1bccc583eb7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.337098 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 278/563] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.342356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ec7c4-7243-4e46-b1eb-a5560c0db178 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.352074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ec7c4-7243-4e46-b1eb-a5560c0db178 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.352694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 286/564] 10.222.0.83 () {56 vars in 1158 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.353617 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b8cb1-4d04-4339-ae08-a1bccc583eb7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.361881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800de8d-dc8c-4afc-a852-609c70ad0065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.362679 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800de8d-dc8c-4afc-a852-609c70ad0065 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.362955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800de8d-dc8c-4afc-a852-609c70ad0065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.363224 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800de8d-dc8c-4afc-a852-609c70ad0065 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.364745 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b8cb1-4d04-4339-ae08-a1bccc583eb7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.370066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14204530-8155-4317-a01f-ae5aeb223fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.370855 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14204530-8155-4317-a01f-ae5aeb223fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.371015 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800de8d-dc8c-4afc-a852-609c70ad0065 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.371117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14204530-8155-4317-a01f-ae5aeb223fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.371399 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14204530-8155-4317-a01f-ae5aeb223fb1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.372996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800de8d-dc8c-4afc-a852-609c70ad0065 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.382477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14204530-8155-4317-a01f-ae5aeb223fb1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:24.386683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-1800de8d-dc8c-4afc-a852-609c70ad0065 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:24.395594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 279/565] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.395594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800de8d-dc8c-4afc-a852-609c70ad0065 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.395828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-14204530-8155-4317-a01f-ae5aeb223fb1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:24.395828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 287/566] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.395828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14204530-8155-4317-a01f-ae5aeb223fb1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.400962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800de8d-dc8c-4afc-a852-609c70ad0065 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.405404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c526206-b477-4710-ba8a-47a0417a94f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.405934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14204530-8155-4317-a01f-ae5aeb223fb1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.406205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c526206-b477-4710-ba8a-47a0417a94f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.406484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c526206-b477-4710-ba8a-47a0417a94f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.406756 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c526206-b477-4710-ba8a-47a0417a94f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.411161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5729a-3e55-4aaf-a387-9879bdea5ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.412084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5729a-3e55-4aaf-a387-9879bdea5ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.412528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5729a-3e55-4aaf-a387-9879bdea5ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.413540 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5729a-3e55-4aaf-a387-9879bdea5ae7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.418766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c526206-b477-4710-ba8a-47a0417a94f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.420748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c526206-b477-4710-ba8a-47a0417a94f3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.426750 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5729a-3e55-4aaf-a387-9879bdea5ae7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.429501 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5729a-3e55-4aaf-a387-9879bdea5ae7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.439074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-1c526206-b477-4710-ba8a-47a0417a94f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:24.440261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 280/567] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.441018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c526206-b477-4710-ba8a-47a0417a94f3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.447299 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-b7e5729a-3e55-4aaf-a387-9879bdea5ae7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:24.448937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 288/568] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.449950 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5729a-3e55-4aaf-a387-9879bdea5ae7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.458407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c526206-b477-4710-ba8a-47a0417a94f3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.459379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5729a-3e55-4aaf-a387-9879bdea5ae7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.462918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2b212-5e6b-4d6d-b575-28bdda89db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.463567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2b212-5e6b-4d6d-b575-28bdda89db79 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.463850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aec9bd-7bad-457e-bf46-5fcd62336a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.463957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2b212-5e6b-4d6d-b575-28bdda89db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.464131 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2b212-5e6b-4d6d-b575-28bdda89db79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.464478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aec9bd-7bad-457e-bf46-5fcd62336a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.464762 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aec9bd-7bad-457e-bf46-5fcd62336a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.464909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2b212-5e6b-4d6d-b575-28bdda89db79 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.465053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aec9bd-7bad-457e-bf46-5fcd62336a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.465228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2b212-5e6b-4d6d-b575-28bdda89db79 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.465803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aec9bd-7bad-457e-bf46-5fcd62336a98 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.466114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aec9bd-7bad-457e-bf46-5fcd62336a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.467108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2b212-5e6b-4d6d-b575-28bdda89db79 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.467666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aec9bd-7bad-457e-bf46-5fcd62336a98 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.477941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 289/569] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.482963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aec9bd-7bad-457e-bf46-5fcd62336a98 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.483106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 281/570] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.483106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2b212-5e6b-4d6d-b575-28bdda89db79 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.493089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2b212-5e6b-4d6d-b575-28bdda89db79 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.494092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aec9bd-7bad-457e-bf46-5fcd62336a98 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.498049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619a6e3-a27a-4e1c-843d-9c5a4f73a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.498405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e03e87-c1f6-4448-aec0-baa0bead242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.498693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a6e3-a27a-4e1c-843d-9c5a4f73a3ca admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.498976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a6e3-a27a-4e1c-843d-9c5a4f73a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.499066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03e87-c1f6-4448-aec0-baa0bead242e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.499253 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a6e3-a27a-4e1c-843d-9c5a4f73a3ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.499355 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03e87-c1f6-4448-aec0-baa0bead242e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.499579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03e87-c1f6-4448-aec0-baa0bead242e admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.500200 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619a6e3-a27a-4e1c-843d-9c5a4f73a3ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.500303 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619a6e3-a27a-4e1c-843d-9c5a4f73a3ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.500463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e03e87-c1f6-4448-aec0-baa0bead242e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.500721 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e03e87-c1f6-4448-aec0-baa0bead242e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.501922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619a6e3-a27a-4e1c-843d-9c5a4f73a3ca admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.502311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e03e87-c1f6-4448-aec0-baa0bead242e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.522837 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 290/571] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.523018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 282/572] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.523133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e03e87-c1f6-4448-aec0-baa0bead242e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.523217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619a6e3-a27a-4e1c-843d-9c5a4f73a3ca admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.524597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619a6e3-a27a-4e1c-843d-9c5a4f73a3ca admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.528934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918f4e-a6ce-4c00-bb4b-abdc87ad7c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.529834 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918f4e-a6ce-4c00-bb4b-abdc87ad7c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.530118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918f4e-a6ce-4c00-bb4b-abdc87ad7c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.530394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918f4e-a6ce-4c00-bb4b-abdc87ad7c81 admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/a34b3d2f67b1477598acce389819c70a/roles/35803c6179744bf1933e2b30b362f87d` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.533062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e03e87-c1f6-4448-aec0-baa0bead242e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.537440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d41ea-151f-4eb2-bd43-d6f8ec7ae7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.538778 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d41ea-151f-4eb2-bd43-d6f8ec7ae7bb admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.539066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d41ea-151f-4eb2-bd43-d6f8ec7ae7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.539335 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d41ea-151f-4eb2-bd43-d6f8ec7ae7bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.546216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b918f4e-a6ce-4c00-bb4b-abdc87ad7c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=a34b3d2f67b1477598acce389819c70a, role_id=35803c6179744bf1933e2b30b362f87d)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.548850 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b918f4e-a6ce-4c00-bb4b-abdc87ad7c81 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.550142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d41ea-151f-4eb2-bd43-d6f8ec7ae7bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.551934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d41ea-151f-4eb2-bd43-d6f8ec7ae7bb admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.564477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 283/573] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:24:24 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/a34b3d2f67b1477598acce389819c70a/roles/35803c6179744bf1933e2b30b362f87d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:24.565452 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918f4e-a6ce-4c00-bb4b-abdc87ad7c81 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.570505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-2e7d41ea-151f-4eb2-bd43-d6f8ec7ae7bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:24.571954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 291/574] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.572692 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d41ea-151f-4eb2-bd43-d6f8ec7ae7bb admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.584940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d41ea-151f-4eb2-bd43-d6f8ec7ae7bb admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.659666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918f4e-a6ce-4c00-bb4b-abdc87ad7c81 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.662081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59a077-e7a3-4720-ba81-a2380a416f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.663500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59a077-e7a3-4720-ba81-a2380a416f56 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.664058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59a077-e7a3-4720-ba81-a2380a416f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.664255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59a077-e7a3-4720-ba81-a2380a416f56 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.666584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8244-95c8-4616-b3e1-999733b9e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.668049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8244-95c8-4616-b3e1-999733b9e3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.668522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8244-95c8-4616-b3e1-999733b9e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.668975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8244-95c8-4616-b3e1-999733b9e3ce admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.672940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59a077-e7a3-4720-ba81-a2380a416f56 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.674818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59a077-e7a3-4720-ba81-a2380a416f56 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.679417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b8244-95c8-4616-b3e1-999733b9e3ce admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.681693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b8244-95c8-4616-b3e1-999733b9e3ce admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.691957 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-8d59a077-e7a3-4720-ba81-a2380a416f56 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:24.693399 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 292/575] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.694408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59a077-e7a3-4720-ba81-a2380a416f56 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.697928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-3f5b8244-95c8-4616-b3e1-999733b9e3ce admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 13:24:24.700041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 284/576] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/users/neutron => generated 85 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.701596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8244-95c8-4616-b3e1-999733b9e3ce admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.705297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59a077-e7a3-4720-ba81-a2380a416f56 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.710894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f4eb2-ece2-4515-9754-508561a648af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.711677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f4eb2-ece2-4515-9754-508561a648af admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.711960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f4eb2-ece2-4515-9754-508561a648af admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.712240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f4eb2-ece2-4515-9754-508561a648af admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.713107 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f4eb2-ece2-4515-9754-508561a648af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.713517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f4eb2-ece2-4515-9754-508561a648af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.714429 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8244-95c8-4616-b3e1-999733b9e3ce admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.715269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f4eb2-ece2-4515-9754-508561a648af admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.721045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf288a-fb05-426c-a662-3b5e2cce985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.722159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf288a-fb05-426c-a662-3b5e2cce985d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.722621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf288a-fb05-426c-a662-3b5e2cce985d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.723800 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf288a-fb05-426c-a662-3b5e2cce985d admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.724848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf288a-fb05-426c-a662-3b5e2cce985d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.726370 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf288a-fb05-426c-a662-3b5e2cce985d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.728281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf288a-fb05-426c-a662-3b5e2cce985d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.733714 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 293/577] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.735243 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f4eb2-ece2-4515-9754-508561a648af admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.743665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 285/578] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.745089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b181380-0a86-40b5-b2fd-a43024fc781e None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.745428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b181380-0a86-40b5-b2fd-a43024fc781e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.745708 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b181380-0a86-40b5-b2fd-a43024fc781e None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.747646 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 286/579] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:24.748654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b181380-0a86-40b5-b2fd-a43024fc781e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.749439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f4eb2-ece2-4515-9754-508561a648af admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.761024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb918767-394d-4f3a-b8bf-2679685d6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.761744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb918767-394d-4f3a-b8bf-2679685d6625 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.762056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb918767-394d-4f3a-b8bf-2679685d6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.762330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb918767-394d-4f3a-b8bf-2679685d6625 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.763201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb918767-394d-4f3a-b8bf-2679685d6625 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.763508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb918767-394d-4f3a-b8bf-2679685d6625 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.765367 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb918767-394d-4f3a-b8bf-2679685d6625 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.770249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b181380-0a86-40b5-b2fd-a43024fc781e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.775132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee3c49-f62a-4ddc-8c82-476ec150da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.775918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee3c49-f62a-4ddc-8c82-476ec150da99 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.776195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee3c49-f62a-4ddc-8c82-476ec150da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.776465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee3c49-f62a-4ddc-8c82-476ec150da99 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.784430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee3c49-f62a-4ddc-8c82-476ec150da99 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.790184 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 294/580] 10.222.0.83 () {56 vars in 1160 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.790354 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee3c49-f62a-4ddc-8c82-476ec150da99 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.790430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b21834-496a-459b-9745-4e49c99c9991 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.790430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b21834-496a-459b-9745-4e49c99c9991 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.790430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b21834-496a-459b-9745-4e49c99c9991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.807489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-f4ee3c49-f62a-4ddc-8c82-476ec150da99 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 13:24:24.808232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e5b21834-496a-459b-9745-4e49c99c9991 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:24.809145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 287/581] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/users/cinder => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.813882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee3c49-f62a-4ddc-8c82-476ec150da99 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.814026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e5b21834-496a-459b-9745-4e49c99c9991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:24.820621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee3c49-f62a-4ddc-8c82-476ec150da99 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.825029 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 295/582] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:24.825788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9dbc1-772e-4fd9-a751-229e84ae398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.825914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b21834-496a-459b-9745-4e49c99c9991 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.826872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9dbc1-772e-4fd9-a751-229e84ae398f admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.827157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9dbc1-772e-4fd9-a751-229e84ae398f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.827429 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9dbc1-772e-4fd9-a751-229e84ae398f admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/80ddafedf2734326832ab4bf620f7634/roles/35803c6179744bf1933e2b30b362f87d` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.839857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b21834-496a-459b-9745-4e49c99c9991 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.843620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9dbc1-772e-4fd9-a751-229e84ae398f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=80ddafedf2734326832ab4bf620f7634, role_id=35803c6179744bf1933e2b30b362f87d)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.844373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc343ac-771b-4d2d-9f7b-b432883ee74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.845159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc343ac-771b-4d2d-9f7b-b432883ee74c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.845438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc343ac-771b-4d2d-9f7b-b432883ee74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.845712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc343ac-771b-4d2d-9f7b-b432883ee74c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.846298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9dbc1-772e-4fd9-a751-229e84ae398f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.858437 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc343ac-771b-4d2d-9f7b-b432883ee74c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.859824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 288/583] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:24:24 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/80ddafedf2734326832ab4bf620f7634/roles/35803c6179744bf1933e2b30b362f87d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:24.861900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc343ac-771b-4d2d-9f7b-b432883ee74c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.862032 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9dbc1-772e-4fd9-a751-229e84ae398f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.883073 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-8cc343ac-771b-4d2d-9f7b-b432883ee74c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:24.885329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 296/584] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:24.886416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc343ac-771b-4d2d-9f7b-b432883ee74c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.901014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc343ac-771b-4d2d-9f7b-b432883ee74c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.935348 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9dbc1-772e-4fd9-a751-229e84ae398f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.941107 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ed092-602d-4f3d-8a75-cecfced8ff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.941884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed092-602d-4f3d-8a75-cecfced8ff76 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.942216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed092-602d-4f3d-8a75-cecfced8ff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.942551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed092-602d-4f3d-8a75-cecfced8ff76 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.943590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ed092-602d-4f3d-8a75-cecfced8ff76 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.943780 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ed092-602d-4f3d-8a75-cecfced8ff76 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.945866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ed092-602d-4f3d-8a75-cecfced8ff76 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.966986 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 289/585] 10.222.0.83 () {56 vars in 1158 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:24.967850 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ed092-602d-4f3d-8a75-cecfced8ff76 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:24.978610 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ed092-602d-4f3d-8a75-cecfced8ff76 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:24.979311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be802845-d247-4e9f-bc07-b890b5621002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.980590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be802845-d247-4e9f-bc07-b890b5621002 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.981112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be802845-d247-4e9f-bc07-b890b5621002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.981619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be802845-d247-4e9f-bc07-b890b5621002 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.983412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fbc9e-0271-4904-a134-8feda166bae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:24.984151 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fbc9e-0271-4904-a134-8feda166bae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:24.984529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fbc9e-0271-4904-a134-8feda166bae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:24.984784 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fbc9e-0271-4904-a134-8feda166bae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:24.985546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fbc9e-0271-4904-a134-8feda166bae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:24.985999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fbc9e-0271-4904-a134-8feda166bae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:24.987632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fbc9e-0271-4904-a134-8feda166bae4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:24.995713 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be802845-d247-4e9f-bc07-b890b5621002 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:25.002473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 290/586] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:25.003441 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fbc9e-0271-4904-a134-8feda166bae4 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.005298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-be802845-d247-4e9f-bc07-b890b5621002 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:25.007021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 297/587] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:25.008295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be802845-d247-4e9f-bc07-b890b5621002 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.014202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fbc9e-0271-4904-a134-8feda166bae4 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.019820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbdc5a-53a2-451f-a036-3cfa3bc0a389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.020682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbdc5a-53a2-451f-a036-3cfa3bc0a389 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.021007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbdc5a-53a2-451f-a036-3cfa3bc0a389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.021285 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbdc5a-53a2-451f-a036-3cfa3bc0a389 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.022019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be802845-d247-4e9f-bc07-b890b5621002 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.028137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bba5cb-3460-427c-8bed-a3e6527617e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.029161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba5cb-3460-427c-8bed-a3e6527617e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.029617 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba5cb-3460-427c-8bed-a3e6527617e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.030064 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba5cb-3460-427c-8bed-a3e6527617e6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.037492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbdc5a-53a2-451f-a036-3cfa3bc0a389 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.040249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbdc5a-53a2-451f-a036-3cfa3bc0a389 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.041093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bba5cb-3460-427c-8bed-a3e6527617e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.044014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bba5cb-3460-427c-8bed-a3e6527617e6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.058706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-b3bbdc5a-53a2-451f-a036-3cfa3bc0a389 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:25.060396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-68bba5cb-3460-427c-8bed-a3e6527617e6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:25.060724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 291/588] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:25.061602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbdc5a-53a2-451f-a036-3cfa3bc0a389 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.062472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 298/589] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:25.070789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bba5cb-3460-427c-8bed-a3e6527617e6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.079106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbdc5a-53a2-451f-a036-3cfa3bc0a389 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.084491 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff84802-8630-4cd3-8802-77e2dc2256e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.085343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bba5cb-3460-427c-8bed-a3e6527617e6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.086333 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84802-8630-4cd3-8802-77e2dc2256e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.086849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84802-8630-4cd3-8802-77e2dc2256e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.087327 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84802-8630-4cd3-8802-77e2dc2256e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.088337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff84802-8630-4cd3-8802-77e2dc2256e2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:25.088932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff84802-8630-4cd3-8802-77e2dc2256e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.089933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34d70a-a4a9-4d97-a67f-7fbcb4e209c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.090813 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34d70a-a4a9-4d97-a67f-7fbcb4e209c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.091094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34d70a-a4a9-4d97-a67f-7fbcb4e209c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.091361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34d70a-a4a9-4d97-a67f-7fbcb4e209c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.091868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff84802-8630-4cd3-8802-77e2dc2256e2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.092125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34d70a-a4a9-4d97-a67f-7fbcb4e209c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:25.092388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34d70a-a4a9-4d97-a67f-7fbcb4e209c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.094300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34d70a-a4a9-4d97-a67f-7fbcb4e209c4 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.104958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 292/590] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:25.106417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff84802-8630-4cd3-8802-77e2dc2256e2 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.108716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 299/591] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:25.114774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34d70a-a4a9-4d97-a67f-7fbcb4e209c4 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.117163 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff84802-8630-4cd3-8802-77e2dc2256e2 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.122217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99db12d-9699-4859-981c-6bf20f8fab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.123674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99db12d-9699-4859-981c-6bf20f8fab2b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.124162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99db12d-9699-4859-981c-6bf20f8fab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.124872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99db12d-9699-4859-981c-6bf20f8fab2b admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.125945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99db12d-9699-4859-981c-6bf20f8fab2b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:25.126397 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99db12d-9699-4859-981c-6bf20f8fab2b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.127040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34d70a-a4a9-4d97-a67f-7fbcb4e209c4 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.128795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99db12d-9699-4859-981c-6bf20f8fab2b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.132267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773d3e8-b672-42bb-be2c-c020b0a4ba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.133117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773d3e8-b672-42bb-be2c-c020b0a4ba3a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.133459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773d3e8-b672-42bb-be2c-c020b0a4ba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.133819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773d3e8-b672-42bb-be2c-c020b0a4ba3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.143491 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 293/592] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:25.144447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99db12d-9699-4859-981c-6bf20f8fab2b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.144555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773d3e8-b672-42bb-be2c-c020b0a4ba3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.146481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773d3e8-b672-42bb-be2c-c020b0a4ba3a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.159596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99db12d-9699-4859-981c-6bf20f8fab2b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.164144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fec714-6c55-4046-a726-8876847f214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.164324 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-a773d3e8-b672-42bb-be2c-c020b0a4ba3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:25.164934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fec714-6c55-4046-a726-8876847f214f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.165212 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fec714-6c55-4046-a726-8876847f214f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.165483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fec714-6c55-4046-a726-8876847f214f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.165597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 300/593] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:25.166338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773d3e8-b672-42bb-be2c-c020b0a4ba3a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.173877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fec714-6c55-4046-a726-8876847f214f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.175715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773d3e8-b672-42bb-be2c-c020b0a4ba3a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.175829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fec714-6c55-4046-a726-8876847f214f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.180139 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a3970-b3d5-4a36-b635-41d36f789002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.180992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a3970-b3d5-4a36-b635-41d36f789002 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.181263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a3970-b3d5-4a36-b635-41d36f789002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.181528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a3970-b3d5-4a36-b635-41d36f789002 admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/de1632f6a5414d2abfdee3b5bdd941cd/roles/35803c6179744bf1933e2b30b362f87d` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.191362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-29fec714-6c55-4046-a726-8876847f214f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:25.193180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 294/594] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:25.194487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fec714-6c55-4046-a726-8876847f214f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.201830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a3970-b3d5-4a36-b635-41d36f789002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=de1632f6a5414d2abfdee3b5bdd941cd, role_id=35803c6179744bf1933e2b30b362f87d)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.204486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fec714-6c55-4046-a726-8876847f214f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.204624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a3970-b3d5-4a36-b635-41d36f789002 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.211177 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efed196-2661-44f5-99de-c4137f80a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.211447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efed196-2661-44f5-99de-c4137f80a4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.211764 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efed196-2661-44f5-99de-c4137f80a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.212053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efed196-2661-44f5-99de-c4137f80a4b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.212844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efed196-2661-44f5-99de-c4137f80a4b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:25.213195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efed196-2661-44f5-99de-c4137f80a4b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.215132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efed196-2661-44f5-99de-c4137f80a4b6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.220009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 301/595] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:24:25 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/de1632f6a5414d2abfdee3b5bdd941cd/roles/35803c6179744bf1933e2b30b362f87d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:25.220883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a3970-b3d5-4a36-b635-41d36f789002 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.228360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 295/596] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:25.234909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efed196-2661-44f5-99de-c4137f80a4b6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.246497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efed196-2661-44f5-99de-c4137f80a4b6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.287709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a3970-b3d5-4a36-b635-41d36f789002 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.292672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1700f-dc2b-499d-acf0-3b176e2779a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.293375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1700f-dc2b-499d-acf0-3b176e2779a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.293655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1700f-dc2b-499d-acf0-3b176e2779a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.294001 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1700f-dc2b-499d-acf0-3b176e2779a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.294852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1700f-dc2b-499d-acf0-3b176e2779a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:25.295156 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1700f-dc2b-499d-acf0-3b176e2779a0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.297031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1700f-dc2b-499d-acf0-3b176e2779a0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.309876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 302/597] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:25.315517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae671b-d190-4c13-92f5-aaeb7037582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.316181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1700f-dc2b-499d-acf0-3b176e2779a0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.316496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae671b-d190-4c13-92f5-aaeb7037582e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.316844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae671b-d190-4c13-92f5-aaeb7037582e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.317290 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae671b-d190-4c13-92f5-aaeb7037582e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.327107 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae671b-d190-4c13-92f5-aaeb7037582e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.327360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1700f-dc2b-499d-acf0-3b176e2779a0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.329330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae671b-d190-4c13-92f5-aaeb7037582e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.332179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2b720-3023-4d11-81dc-aa183420dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.333124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2b720-3023-4d11-81dc-aa183420dd50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.333398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2b720-3023-4d11-81dc-aa183420dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.333715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2b720-3023-4d11-81dc-aa183420dd50 admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/63a5db2990424915ac1daf36d14a733b/roles/35803c6179744bf1933e2b30b362f87d` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.346826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-c1ae671b-d190-4c13-92f5-aaeb7037582e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:24:25.348905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 296/598] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/users/swift => generated 83 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:25.351292 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2b720-3023-4d11-81dc-aa183420dd50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=63a5db2990424915ac1daf36d14a733b, role_id=35803c6179744bf1933e2b30b362f87d)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.354050 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2b720-3023-4d11-81dc-aa183420dd50 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.355749 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae671b-d190-4c13-92f5-aaeb7037582e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.368736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 303/599] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:24:25 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/63a5db2990424915ac1daf36d14a733b/roles/35803c6179744bf1933e2b30b362f87d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:25.371404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae671b-d190-4c13-92f5-aaeb7037582e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.447170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637dbc1-f265-4bb5-8be4-ccbebc30a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.447767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637dbc1-f265-4bb5-8be4-ccbebc30a60b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.448049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637dbc1-f265-4bb5-8be4-ccbebc30a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.448326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637dbc1-f265-4bb5-8be4-ccbebc30a60b admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.449189 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637dbc1-f265-4bb5-8be4-ccbebc30a60b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:25.449495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637dbc1-f265-4bb5-8be4-ccbebc30a60b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.451423 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637dbc1-f265-4bb5-8be4-ccbebc30a60b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.471805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 297/600] 10.222.0.83 () {56 vars in 1156 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:25.478182 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2b720-3023-4d11-81dc-aa183420dd50 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.500108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2b720-3023-4d11-81dc-aa183420dd50 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.514279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56affd0d-201b-4080-a4c6-5d22f8d62d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.515026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56affd0d-201b-4080-a4c6-5d22f8d62d08 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.515307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56affd0d-201b-4080-a4c6-5d22f8d62d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.515581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56affd0d-201b-4080-a4c6-5d22f8d62d08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.526705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56affd0d-201b-4080-a4c6-5d22f8d62d08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.528764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56affd0d-201b-4080-a4c6-5d22f8d62d08 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.548156 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 304/601] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:25.555304 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637dbc1-f265-4bb5-8be4-ccbebc30a60b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.569877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637dbc1-f265-4bb5-8be4-ccbebc30a60b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.581866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df821e5-0187-4281-b9c6-99de26d309c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.582738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df821e5-0187-4281-b9c6-99de26d309c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.583073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df821e5-0187-4281-b9c6-99de26d309c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.583345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df821e5-0187-4281-b9c6-99de26d309c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.600955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df821e5-0187-4281-b9c6-99de26d309c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.602882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df821e5-0187-4281-b9c6-99de26d309c0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.632985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-4df821e5-0187-4281-b9c6-99de26d309c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:25.634660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 298/602] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:25.640396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56affd0d-201b-4080-a4c6-5d22f8d62d08 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.657824 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56affd0d-201b-4080-a4c6-5d22f8d62d08 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.662676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717fb77-b6e0-4717-961a-44030cf13069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.663599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717fb77-b6e0-4717-961a-44030cf13069 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.664030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717fb77-b6e0-4717-961a-44030cf13069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.664474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717fb77-b6e0-4717-961a-44030cf13069 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.665373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717fb77-b6e0-4717-961a-44030cf13069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:25.665864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717fb77-b6e0-4717-961a-44030cf13069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.667609 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717fb77-b6e0-4717-961a-44030cf13069 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.682091 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 305/603] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:25.688339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df821e5-0187-4281-b9c6-99de26d309c0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.699007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df821e5-0187-4281-b9c6-99de26d309c0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.703795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd360-cca2-45e4-a476-9f1e71101654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.704579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd360-cca2-45e4-a476-9f1e71101654 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.704867 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd360-cca2-45e4-a476-9f1e71101654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.705139 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd360-cca2-45e4-a476-9f1e71101654 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.712332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd360-cca2-45e4-a476-9f1e71101654 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.714346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd360-cca2-45e4-a476-9f1e71101654 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.727752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-27bcd360-cca2-45e4-a476-9f1e71101654 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:25.729292 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 299/604] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:25.738026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717fb77-b6e0-4717-961a-44030cf13069 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.748476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717fb77-b6e0-4717-961a-44030cf13069 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.753166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e5b13-be0c-4dff-9561-8d13da34c2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.753854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5b13-be0c-4dff-9561-8d13da34c2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.754141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5b13-be0c-4dff-9561-8d13da34c2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.754415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5b13-be0c-4dff-9561-8d13da34c2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.755211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e5b13-be0c-4dff-9561-8d13da34c2b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:25.755523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e5b13-be0c-4dff-9561-8d13da34c2b3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.757936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e5b13-be0c-4dff-9561-8d13da34c2b3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.772094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 306/605] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:25.778472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd360-cca2-45e4-a476-9f1e71101654 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:25.789314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd360-cca2-45e4-a476-9f1e71101654 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:25.794179 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018296f6-2a2a-4753-b5fb-7df1c4d6e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:25.795051 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018296f6-2a2a-4753-b5fb-7df1c4d6e291 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:25.795524 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018296f6-2a2a-4753-b5fb-7df1c4d6e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:25.796012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018296f6-2a2a-4753-b5fb-7df1c4d6e291 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:25.797183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018296f6-2a2a-4753-b5fb-7df1c4d6e291 admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=93ec8ea8a0904d30b6a95c8ebc9dd634) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:25.797693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018296f6-2a2a-4753-b5fb-7df1c4d6e291 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:25.805779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018296f6-2a2a-4753-b5fb-7df1c4d6e291 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:25.812688 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 300/606] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:25 2021] GET /identity/v3/role_assignments?user.id=93ec8ea8a0904d30b6a95c8ebc9dd634&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:27.436328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba6ec0-82a4-4ddf-baf9-52260297183f None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.436854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba6ec0-82a4-4ddf-baf9-52260297183f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.437118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba6ec0-82a4-4ddf-baf9-52260297183f None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.439097 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 307/607] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:27.446033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784d65-e7ae-4f97-8520-6cbb521ba801 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.446513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784d65-e7ae-4f97-8520-6cbb521ba801 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.446586 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784d65-e7ae-4f97-8520-6cbb521ba801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.464884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-8b784d65-e7ae-4f97-8520-6cbb521ba801 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:27.466099 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8b784d65-e7ae-4f97-8520-6cbb521ba801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:27.473985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 301/608] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:27.499010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba6ec0-82a4-4ddf-baf9-52260297183f None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:27.511744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba6ec0-82a4-4ddf-baf9-52260297183f None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:27.516122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b3986-d8a7-411d-9285-1347a1b63c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:27.516906 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3986-d8a7-411d-9285-1347a1b63c86 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.517183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3986-d8a7-411d-9285-1347a1b63c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.517515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3986-d8a7-411d-9285-1347a1b63c86 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.528350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b3986-d8a7-411d-9285-1347a1b63c86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:27.535449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-669b3986-d8a7-411d-9285-1347a1b63c86 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:27.536992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 308/609] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:27.543730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784d65-e7ae-4f97-8520-6cbb521ba801 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:27.552839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784d65-e7ae-4f97-8520-6cbb521ba801 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:27.558030 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894b25d-83db-441a-8efd-0ba3300bb85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:27.558686 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894b25d-83db-441a-8efd-0ba3300bb85a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.559227 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894b25d-83db-441a-8efd-0ba3300bb85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.559495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894b25d-83db-441a-8efd-0ba3300bb85a admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.560251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894b25d-83db-441a-8efd-0ba3300bb85a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:27.560549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894b25d-83db-441a-8efd-0ba3300bb85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:27.562167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894b25d-83db-441a-8efd-0ba3300bb85a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:27.571287 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 302/610] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:27.577116 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b3986-d8a7-411d-9285-1347a1b63c86 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:27.587296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b3986-d8a7-411d-9285-1347a1b63c86 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:27.591978 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5879-b01b-4cc8-a619-3635220ba2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:27.592765 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5879-b01b-4cc8-a619-3635220ba2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.593042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5879-b01b-4cc8-a619-3635220ba2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.593311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5879-b01b-4cc8-a619-3635220ba2c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.605279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df5879-b01b-4cc8-a619-3635220ba2c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:27.607127 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df5879-b01b-4cc8-a619-3635220ba2c0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:27.624764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-e4df5879-b01b-4cc8-a619-3635220ba2c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:27.626285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 309/611] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:27.635039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894b25d-83db-441a-8efd-0ba3300bb85a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:27.649043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894b25d-83db-441a-8efd-0ba3300bb85a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:27.653634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756413ce-56f7-4047-bc85-e50c5c3eb986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:27.654313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756413ce-56f7-4047-bc85-e50c5c3eb986 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.654589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756413ce-56f7-4047-bc85-e50c5c3eb986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.654858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756413ce-56f7-4047-bc85-e50c5c3eb986 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.655971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756413ce-56f7-4047-bc85-e50c5c3eb986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:27.655971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756413ce-56f7-4047-bc85-e50c5c3eb986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:27.661788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756413ce-56f7-4047-bc85-e50c5c3eb986 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:27.677356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 303/612] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:27.683779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5879-b01b-4cc8-a619-3635220ba2c0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:27.694308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5879-b01b-4cc8-a619-3635220ba2c0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:27.698764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e57eb-c190-40b6-b3d7-a041df05988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:27.699549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e57eb-c190-40b6-b3d7-a041df05988c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.699949 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e57eb-c190-40b6-b3d7-a041df05988c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.700225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e57eb-c190-40b6-b3d7-a041df05988c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.708646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e57eb-c190-40b6-b3d7-a041df05988c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:27.710713 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e57eb-c190-40b6-b3d7-a041df05988c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:27.724310 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-4c2e57eb-c190-40b6-b3d7-a041df05988c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:24:27.726447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 310/613] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:27.732507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756413ce-56f7-4047-bc85-e50c5c3eb986 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:27.743159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756413ce-56f7-4047-bc85-e50c5c3eb986 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:27.747702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1bc2b-e7ec-43f0-97c4-757b1b10ee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:27.748431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1bc2b-e7ec-43f0-97c4-757b1b10ee92 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.748709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1bc2b-e7ec-43f0-97c4-757b1b10ee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.748979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1bc2b-e7ec-43f0-97c4-757b1b10ee92 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.749865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1bc2b-e7ec-43f0-97c4-757b1b10ee92 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:27.750161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1bc2b-e7ec-43f0-97c4-757b1b10ee92 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:27.752029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1bc2b-e7ec-43f0-97c4-757b1b10ee92 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:27.770633 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 304/614] 10.222.0.83 () {56 vars in 1154 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:27.777118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e57eb-c190-40b6-b3d7-a041df05988c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:27.787484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e57eb-c190-40b6-b3d7-a041df05988c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:27.792881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcfb57-dd5c-491d-9df4-62c1a5c67aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:27.793547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcfb57-dd5c-491d-9df4-62c1a5c67aea admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.793854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcfb57-dd5c-491d-9df4-62c1a5c67aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.794125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcfb57-dd5c-491d-9df4-62c1a5c67aea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.803432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcfb57-dd5c-491d-9df4-62c1a5c67aea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:27.805218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcfb57-dd5c-491d-9df4-62c1a5c67aea admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:27.815928 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 311/615] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:27.822478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1bc2b-e7ec-43f0-97c4-757b1b10ee92 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:27.832658 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1bc2b-e7ec-43f0-97c4-757b1b10ee92 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:27.837932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188c36f-eb68-4a64-a22e-493f8ef7c7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:27.838720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188c36f-eb68-4a64-a22e-493f8ef7c7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.838991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188c36f-eb68-4a64-a22e-493f8ef7c7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.839259 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188c36f-eb68-4a64-a22e-493f8ef7c7ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.850267 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188c36f-eb68-4a64-a22e-493f8ef7c7ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:27.852726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188c36f-eb68-4a64-a22e-493f8ef7c7ac admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:27.870194 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-1188c36f-eb68-4a64-a22e-493f8ef7c7ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:27.871676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 305/616] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:27.877531 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcfb57-dd5c-491d-9df4-62c1a5c67aea admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:27.886717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcfb57-dd5c-491d-9df4-62c1a5c67aea admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:27.891284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0f07f-9ff8-4047-a4fb-69679d36a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:27.891982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0f07f-9ff8-4047-a4fb-69679d36a2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.892266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0f07f-9ff8-4047-a4fb-69679d36a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.892537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0f07f-9ff8-4047-a4fb-69679d36a2c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.893255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0f07f-9ff8-4047-a4fb-69679d36a2c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:27.893553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0f07f-9ff8-4047-a4fb-69679d36a2c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:27.895155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0f07f-9ff8-4047-a4fb-69679d36a2c2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:27.909067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 312/617] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:27.915533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188c36f-eb68-4a64-a22e-493f8ef7c7ac admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:27.926150 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188c36f-eb68-4a64-a22e-493f8ef7c7ac admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:27.931251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181413be-b9a3-48c9-9234-085b0f677eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:27.932114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181413be-b9a3-48c9-9234-085b0f677eeb admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.932563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181413be-b9a3-48c9-9234-085b0f677eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.932842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181413be-b9a3-48c9-9234-085b0f677eeb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.939747 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f0747-04a6-4483-8847-6d35d3c05dfa None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.940054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f0747-04a6-4483-8847-6d35d3c05dfa None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.940278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f0747-04a6-4483-8847-6d35d3c05dfa None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.942156 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 313/618] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:27.946416 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181413be-b9a3-48c9-9234-085b0f677eeb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:27.948472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181413be-b9a3-48c9-9234-085b0f677eeb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:27.960433 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377e510-594d-45eb-a091-df796c2b0e28 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:27.960739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377e510-594d-45eb-a091-df796c2b0e28 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:27.961071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377e510-594d-45eb-a091-df796c2b0e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:27.979465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-181413be-b9a3-48c9-9234-085b0f677eeb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:27.980693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 306/619] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:27.986316 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5377e510-594d-45eb-a091-df796c2b0e28 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:27.987496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5377e510-594d-45eb-a091-df796c2b0e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:27.995678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 314/620] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:27.998124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181413be-b9a3-48c9-9234-085b0f677eeb admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.008894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181413be-b9a3-48c9-9234-085b0f677eeb admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.013357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84da1-59e0-4c9b-8b06-4c9b047acdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.014063 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84da1-59e0-4c9b-8b06-4c9b047acdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.014338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84da1-59e0-4c9b-8b06-4c9b047acdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.014603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84da1-59e0-4c9b-8b06-4c9b047acdc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.015450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c84da1-59e0-4c9b-8b06-4c9b047acdc6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.015751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c84da1-59e0-4c9b-8b06-4c9b047acdc6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.017608 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c84da1-59e0-4c9b-8b06-4c9b047acdc6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.030726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 307/621] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:28.036649 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377e510-594d-45eb-a091-df796c2b0e28 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.047066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377e510-594d-45eb-a091-df796c2b0e28 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.048611 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84da1-59e0-4c9b-8b06-4c9b047acdc6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.060490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaccfb-f76e-4f07-bdd2-2aa57e8723e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.061155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaccfb-f76e-4f07-bdd2-2aa57e8723e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.061432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaccfb-f76e-4f07-bdd2-2aa57e8723e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.061783 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaccfb-f76e-4f07-bdd2-2aa57e8723e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.063934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaccfb-f76e-4f07-bdd2-2aa57e8723e9 admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=a34b3d2f67b1477598acce389819c70a) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.064298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaccfb-f76e-4f07-bdd2-2aa57e8723e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.066269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaccfb-f76e-4f07-bdd2-2aa57e8723e9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.066877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84da1-59e0-4c9b-8b06-4c9b047acdc6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.073286 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 315/622] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/role_assignments?user.id=a34b3d2f67b1477598acce389819c70a&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:28.078604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6320c37-e9da-42ce-bf02-eabc06ab4996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.079422 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320c37-e9da-42ce-bf02-eabc06ab4996 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.079706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320c37-e9da-42ce-bf02-eabc06ab4996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.079987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320c37-e9da-42ce-bf02-eabc06ab4996 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.102973 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6320c37-e9da-42ce-bf02-eabc06ab4996 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:28.110094 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-d6320c37-e9da-42ce-bf02-eabc06ab4996 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:28.111652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 308/623] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:28.119104 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaccfb-f76e-4f07-bdd2-2aa57e8723e9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.147912 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaccfb-f76e-4f07-bdd2-2aa57e8723e9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.162702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1062d-866c-4de9-98ef-ff2bb4a99eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.163621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1062d-866c-4de9-98ef-ff2bb4a99eac admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.164010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1062d-866c-4de9-98ef-ff2bb4a99eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.164374 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1062d-866c-4de9-98ef-ff2bb4a99eac admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.165276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1062d-866c-4de9-98ef-ff2bb4a99eac admin admin] RBAC: Adding query filter params (name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.165690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1062d-866c-4de9-98ef-ff2bb4a99eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.167556 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1062d-866c-4de9-98ef-ff2bb4a99eac admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.177390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 316/624] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:28.185216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6320c37-e9da-42ce-bf02-eabc06ab4996 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.208665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6320c37-e9da-42ce-bf02-eabc06ab4996 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.216664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e8e1d-39c9-42e6-b23f-edca405ee37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.218074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e8e1d-39c9-42e6-b23f-edca405ee37d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.218603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e8e1d-39c9-42e6-b23f-edca405ee37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.219088 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e8e1d-39c9-42e6-b23f-edca405ee37d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.234689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e8e1d-39c9-42e6-b23f-edca405ee37d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.237303 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e8e1d-39c9-42e6-b23f-edca405ee37d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.257507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-3f4e8e1d-39c9-42e6-b23f-edca405ee37d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:28.259299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 309/625] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:28.266942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1062d-866c-4de9-98ef-ff2bb4a99eac admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.282682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1062d-866c-4de9-98ef-ff2bb4a99eac admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.287899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5e6e2-49f6-4545-ae8f-cc094d89951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.288730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5e6e2-49f6-4545-ae8f-cc094d89951d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.289108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5e6e2-49f6-4545-ae8f-cc094d89951d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.289477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5e6e2-49f6-4545-ae8f-cc094d89951d admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.290397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5e6e2-49f6-4545-ae8f-cc094d89951d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.290856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5e6e2-49f6-4545-ae8f-cc094d89951d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.292627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5e6e2-49f6-4545-ae8f-cc094d89951d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.311510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 317/626] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:28.318269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e8e1d-39c9-42e6-b23f-edca405ee37d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.329301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e8e1d-39c9-42e6-b23f-edca405ee37d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.338253 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086624ec-6a6b-4acf-a582-d3b6949db891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.339213 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086624ec-6a6b-4acf-a582-d3b6949db891 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.339608 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086624ec-6a6b-4acf-a582-d3b6949db891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.339974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086624ec-6a6b-4acf-a582-d3b6949db891 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.350124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086624ec-6a6b-4acf-a582-d3b6949db891 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.352332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086624ec-6a6b-4acf-a582-d3b6949db891 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.367251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-086624ec-6a6b-4acf-a582-d3b6949db891 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 13:24:28.368891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 310/627] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:28.379224 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5e6e2-49f6-4545-ae8f-cc094d89951d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.390695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5e6e2-49f6-4545-ae8f-cc094d89951d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.401272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62ec7-14f3-4999-943a-a4813c263425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.402215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62ec7-14f3-4999-943a-a4813c263425 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.402620 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62ec7-14f3-4999-943a-a4813c263425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.403062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62ec7-14f3-4999-943a-a4813c263425 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.404020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e62ec7-14f3-4999-943a-a4813c263425 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.404470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e62ec7-14f3-4999-943a-a4813c263425 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.406543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e62ec7-14f3-4999-943a-a4813c263425 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.426614 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 318/628] 10.222.0.83 () {56 vars in 1158 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:28.433702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086624ec-6a6b-4acf-a582-d3b6949db891 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.447602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086624ec-6a6b-4acf-a582-d3b6949db891 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.454391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f71bf-f053-43fc-abfd-9a8ce6952188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.455317 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f71bf-f053-43fc-abfd-9a8ce6952188 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.455762 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f71bf-f053-43fc-abfd-9a8ce6952188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.456271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f71bf-f053-43fc-abfd-9a8ce6952188 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.466279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f71bf-f053-43fc-abfd-9a8ce6952188 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.468476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f71bf-f053-43fc-abfd-9a8ce6952188 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.472063 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245499f-40f6-42f1-b9b9-749479fec9b4 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.472534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245499f-40f6-42f1-b9b9-749479fec9b4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.472813 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245499f-40f6-42f1-b9b9-749479fec9b4 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.475848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 319/629] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:28.482881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e712c2-e985-4e1b-aede-84d4f7292b4a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.482881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e712c2-e985-4e1b-aede-84d4f7292b4a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.482881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e712c2-e985-4e1b-aede-84d4f7292b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.483293 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 311/630] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:28.487454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f71bf-f053-43fc-abfd-9a8ce6952188 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.497926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f71bf-f053-43fc-abfd-9a8ce6952188 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.503442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416fe21-4103-4f74-8ad2-8419ba202c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.504354 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416fe21-4103-4f74-8ad2-8419ba202c4e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.504634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416fe21-4103-4f74-8ad2-8419ba202c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.504733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-21e712c2-e985-4e1b-aede-84d4f7292b4a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:28.504960 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416fe21-4103-4f74-8ad2-8419ba202c4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.505965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-21e712c2-e985-4e1b-aede-84d4f7292b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:28.515578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 320/631] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:28.516978 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42b6c-feab-4221-9f27-e1b1c765b48a None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.517269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42b6c-feab-4221-9f27-e1b1c765b48a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.517552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42b6c-feab-4221-9f27-e1b1c765b48a None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.519651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 321/632] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:28.521410 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416fe21-4103-4f74-8ad2-8419ba202c4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.525774 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416fe21-4103-4f74-8ad2-8419ba202c4e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.525893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3531d6-d548-419d-aeba-859502ee409b None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.525968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3531d6-d548-419d-aeba-859502ee409b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.526251 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3531d6-d548-419d-aeba-859502ee409b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.549990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-fd3531d6-d548-419d-aeba-859502ee409b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:28.552053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-fd3531d6-d548-419d-aeba-859502ee409b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:28.553067 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-7416fe21-4103-4f74-8ad2-8419ba202c4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:28.561493 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 312/633] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:28.562636 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416fe21-4103-4f74-8ad2-8419ba202c4e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.566333 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 322/634] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:28.567525 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3531d6-d548-419d-aeba-859502ee409b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.575165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416fe21-4103-4f74-8ad2-8419ba202c4e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.583612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3531d6-d548-419d-aeba-859502ee409b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.593831 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39c91-ba0c-4705-8a6a-2fb86682a877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.593831 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39c91-ba0c-4705-8a6a-2fb86682a877 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.593831 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39c91-ba0c-4705-8a6a-2fb86682a877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.593831 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39c91-ba0c-4705-8a6a-2fb86682a877 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.598160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a98bc-fbfb-4ce7-a67a-89a611ed478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.598988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a98bc-fbfb-4ce7-a67a-89a611ed478d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.599266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a98bc-fbfb-4ce7-a67a-89a611ed478d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.599539 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a98bc-fbfb-4ce7-a67a-89a611ed478d admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.600314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a98bc-fbfb-4ce7-a67a-89a611ed478d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.600818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a98bc-fbfb-4ce7-a67a-89a611ed478d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.602909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a98bc-fbfb-4ce7-a67a-89a611ed478d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.604581 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be39c91-ba0c-4705-8a6a-2fb86682a877 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:28.611967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-2be39c91-ba0c-4705-8a6a-2fb86682a877 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:28.613359 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 313/635] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:28.614269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39c91-ba0c-4705-8a6a-2fb86682a877 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.616674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 323/636] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:28.620998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a98bc-fbfb-4ce7-a67a-89a611ed478d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.630629 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39c91-ba0c-4705-8a6a-2fb86682a877 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.633386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a98bc-fbfb-4ce7-a67a-89a611ed478d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.645264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525ab65-54a1-4527-87ee-ca17e441e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.646577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525ab65-54a1-4527-87ee-ca17e441e923 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.646894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525ab65-54a1-4527-87ee-ca17e441e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.647167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525ab65-54a1-4527-87ee-ca17e441e923 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.650643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74812d0-51aa-4232-9f13-b212233394a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.651186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74812d0-51aa-4232-9f13-b212233394a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.651525 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74812d0-51aa-4232-9f13-b212233394a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.651736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74812d0-51aa-4232-9f13-b212233394a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.652505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74812d0-51aa-4232-9f13-b212233394a6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.652812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74812d0-51aa-4232-9f13-b212233394a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.654448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74812d0-51aa-4232-9f13-b212233394a6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.664794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 324/637] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:28.665828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74812d0-51aa-4232-9f13-b212233394a6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.669926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525ab65-54a1-4527-87ee-ca17e441e923 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:28.676356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74812d0-51aa-4232-9f13-b212233394a6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.679500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-6525ab65-54a1-4527-87ee-ca17e441e923 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:28.681505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 314/638] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:28.686859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55efdc5-988f-4882-b2f2-229e3773038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.686859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55efdc5-988f-4882-b2f2-229e3773038b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.686859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55efdc5-988f-4882-b2f2-229e3773038b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.686859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55efdc5-988f-4882-b2f2-229e3773038b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.687262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525ab65-54a1-4527-87ee-ca17e441e923 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.700038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55efdc5-988f-4882-b2f2-229e3773038b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.702257 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55efdc5-988f-4882-b2f2-229e3773038b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.706084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525ab65-54a1-4527-87ee-ca17e441e923 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.711257 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c9406-7db3-4166-ab69-0b2926a63b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.712252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9406-7db3-4166-ab69-0b2926a63b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.712908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9406-7db3-4166-ab69-0b2926a63b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.713349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9406-7db3-4166-ab69-0b2926a63b69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.716760 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-d55efdc5-988f-4882-b2f2-229e3773038b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:28.718221 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 325/639] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:28.724043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55efdc5-988f-4882-b2f2-229e3773038b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.727135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c9406-7db3-4166-ab69-0b2926a63b69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.729266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c9406-7db3-4166-ab69-0b2926a63b69 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.736220 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55efdc5-988f-4882-b2f2-229e3773038b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.741808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137133-ca26-4a33-8f10-41e7be8690ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.742515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137133-ca26-4a33-8f10-41e7be8690ec admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.742893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137133-ca26-4a33-8f10-41e7be8690ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.743264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137133-ca26-4a33-8f10-41e7be8690ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.744150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed137133-ca26-4a33-8f10-41e7be8690ec admin admin] RBAC: Adding query filter params (name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.744554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed137133-ca26-4a33-8f10-41e7be8690ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.746282 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed137133-ca26-4a33-8f10-41e7be8690ec admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.754201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-ff0c9406-7db3-4166-ab69-0b2926a63b69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:28.755597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 326/640] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:28.761690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137133-ca26-4a33-8f10-41e7be8690ec admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.761849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 315/641] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:28.763025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c9406-7db3-4166-ab69-0b2926a63b69 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.773732 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c9406-7db3-4166-ab69-0b2926a63b69 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.779590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30af9bf-fd4b-466d-bf83-9f3bbc999b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.780026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137133-ca26-4a33-8f10-41e7be8690ec admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.781058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30af9bf-fd4b-466d-bf83-9f3bbc999b3c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.781693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30af9bf-fd4b-466d-bf83-9f3bbc999b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.782232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30af9bf-fd4b-466d-bf83-9f3bbc999b3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.785013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08124f6a-38cc-4715-abe3-230b503a0e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.785728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08124f6a-38cc-4715-abe3-230b503a0e0e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.786400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08124f6a-38cc-4715-abe3-230b503a0e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.786400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08124f6a-38cc-4715-abe3-230b503a0e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.787358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08124f6a-38cc-4715-abe3-230b503a0e0e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.787807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08124f6a-38cc-4715-abe3-230b503a0e0e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.789738 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08124f6a-38cc-4715-abe3-230b503a0e0e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.796710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30af9bf-fd4b-466d-bf83-9f3bbc999b3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.798777 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30af9bf-fd4b-466d-bf83-9f3bbc999b3c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.809311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 327/642] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:28.814831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08124f6a-38cc-4715-abe3-230b503a0e0e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.821063 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-c30af9bf-fd4b-466d-bf83-9f3bbc999b3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:28.823841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 316/643] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:28.829546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30af9bf-fd4b-466d-bf83-9f3bbc999b3c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.832707 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08124f6a-38cc-4715-abe3-230b503a0e0e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.838803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c6a4e-d978-4174-9b28-4fc3ef27309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.839697 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6a4e-d978-4174-9b28-4fc3ef27309b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.840147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6a4e-d978-4174-9b28-4fc3ef27309b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.840256 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30af9bf-fd4b-466d-bf83-9f3bbc999b3c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.840652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6a4e-d978-4174-9b28-4fc3ef27309b admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.841635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c6a4e-d978-4174-9b28-4fc3ef27309b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.842200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c6a4e-d978-4174-9b28-4fc3ef27309b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.844466 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c6a4e-d978-4174-9b28-4fc3ef27309b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.845521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44582b05-5b39-453c-9345-af59af55710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.846348 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582b05-5b39-453c-9345-af59af55710f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.846789 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582b05-5b39-453c-9345-af59af55710f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.847203 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582b05-5b39-453c-9345-af59af55710f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.848346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44582b05-5b39-453c-9345-af59af55710f admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=80ddafedf2734326832ab4bf620f7634) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.848652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44582b05-5b39-453c-9345-af59af55710f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.850840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44582b05-5b39-453c-9345-af59af55710f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.857514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 317/644] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/role_assignments?user.id=80ddafedf2734326832ab4bf620f7634&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:28.866640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44582b05-5b39-453c-9345-af59af55710f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.866918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 328/645] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:28.868385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c6a4e-d978-4174-9b28-4fc3ef27309b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.879042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c6a4e-d978-4174-9b28-4fc3ef27309b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.884126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44582b05-5b39-453c-9345-af59af55710f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.885528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75dcf6-8102-487f-8dc8-ccf40e3baa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.886597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dcf6-8102-487f-8dc8-ccf40e3baa6a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.887015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dcf6-8102-487f-8dc8-ccf40e3baa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.887411 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dcf6-8102-487f-8dc8-ccf40e3baa6a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.896662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75dcf6-8102-487f-8dc8-ccf40e3baa6a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.899315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d5ef8-66ea-4c6b-b238-436044d66fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.899496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75dcf6-8102-487f-8dc8-ccf40e3baa6a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.900286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d5ef8-66ea-4c6b-b238-436044d66fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.900662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d5ef8-66ea-4c6b-b238-436044d66fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.901084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d5ef8-66ea-4c6b-b238-436044d66fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.902027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d5ef8-66ea-4c6b-b238-436044d66fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.902586 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d5ef8-66ea-4c6b-b238-436044d66fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.904364 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d5ef8-66ea-4c6b-b238-436044d66fdd admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.917339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-4b75dcf6-8102-487f-8dc8-ccf40e3baa6a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 13:24:28.919154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 329/646] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:28.926378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75dcf6-8102-487f-8dc8-ccf40e3baa6a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.935207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 318/647] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:28.946078 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75dcf6-8102-487f-8dc8-ccf40e3baa6a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.951173 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812e3fc-f44f-4796-91fb-8fc243da9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.952130 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e3fc-f44f-4796-91fb-8fc243da9a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.952688 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e3fc-f44f-4796-91fb-8fc243da9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.953102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e3fc-f44f-4796-91fb-8fc243da9a5b admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:28.955717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812e3fc-f44f-4796-91fb-8fc243da9a5b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:28.956217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812e3fc-f44f-4796-91fb-8fc243da9a5b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:28.956966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d5ef8-66ea-4c6b-b238-436044d66fdd admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.958679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812e3fc-f44f-4796-91fb-8fc243da9a5b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:28.978669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d5ef8-66ea-4c6b-b238-436044d66fdd admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:28.984592 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 330/648] 10.222.0.83 () {56 vars in 1158 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:28.990921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812e3fc-f44f-4796-91fb-8fc243da9a5b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:28.992753 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e869-ed73-4fda-827f-08696ecf2dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:28.993801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e869-ed73-4fda-827f-08696ecf2dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:28.994191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e869-ed73-4fda-827f-08696ecf2dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:28.994566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e869-ed73-4fda-827f-08696ecf2dfb admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.003427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812e3fc-f44f-4796-91fb-8fc243da9a5b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.004347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459e869-ed73-4fda-827f-08696ecf2dfb admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.006937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459e869-ed73-4fda-827f-08696ecf2dfb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.008743 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52ed4c-b722-4407-9dce-bdff372b4f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.009583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52ed4c-b722-4407-9dce-bdff372b4f70 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.010041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52ed4c-b722-4407-9dce-bdff372b4f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.010468 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52ed4c-b722-4407-9dce-bdff372b4f70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.022420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52ed4c-b722-4407-9dce-bdff372b4f70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.024040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-c459e869-ed73-4fda-827f-08696ecf2dfb admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 13:24:29.024222 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52ed4c-b722-4407-9dce-bdff372b4f70 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.026018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 319/649] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/users/neutron => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:29.027605 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd296-abd8-4956-ad29-4ca6580b413e None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.028139 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd296-abd8-4956-ad29-4ca6580b413e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.028830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd296-abd8-4956-ad29-4ca6580b413e None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.031866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 320/650] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:29.033376 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd296-abd8-4956-ad29-4ca6580b413e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.036900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 331/651] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:24:29.043701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52ed4c-b722-4407-9dce-bdff372b4f70 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.054832 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd296-abd8-4956-ad29-4ca6580b413e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.055025 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52ed4c-b722-4407-9dce-bdff372b4f70 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.059715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593d04-4776-4679-a66e-f7dbc8ce08a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.060522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593d04-4776-4679-a66e-f7dbc8ce08a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.060798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593d04-4776-4679-a66e-f7dbc8ce08a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.061072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593d04-4776-4679-a66e-f7dbc8ce08a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.061708 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c2734-467e-4f7b-bf0a-7d2ced26666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.062787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2734-467e-4f7b-bf0a-7d2ced26666a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.063549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2734-467e-4f7b-bf0a-7d2ced26666a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.064480 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2734-467e-4f7b-bf0a-7d2ced26666a admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.065572 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c2734-467e-4f7b-bf0a-7d2ced26666a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.066116 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c2734-467e-4f7b-bf0a-7d2ced26666a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.068191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c2734-467e-4f7b-bf0a-7d2ced26666a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.074081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b593d04-4776-4679-a66e-f7dbc8ce08a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.076042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b593d04-4776-4679-a66e-f7dbc8ce08a7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.094302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 321/652] 10.222.0.83 () {56 vars in 1160 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:29.096052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de67127-38a1-47ea-ac48-235349ed59ad None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.096548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de67127-38a1-47ea-ac48-235349ed59ad None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.097046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de67127-38a1-47ea-ac48-235349ed59ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.102569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-5b593d04-4776-4679-a66e-f7dbc8ce08a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:29.104513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 332/653] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:29.105332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593d04-4776-4679-a66e-f7dbc8ce08a7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.118223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-1de67127-38a1-47ea-ac48-235349ed59ad None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:29.119786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1de67127-38a1-47ea-ac48-235349ed59ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:29.121161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593d04-4776-4679-a66e-f7dbc8ce08a7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.125643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1ccb-dbb1-4c4d-b807-ae303012c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.126324 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1ccb-dbb1-4c4d-b807-ae303012c488 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.126601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1ccb-dbb1-4c4d-b807-ae303012c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.126873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1ccb-dbb1-4c4d-b807-ae303012c488 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.129770 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 322/654] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:29.131879 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de67127-38a1-47ea-ac48-235349ed59ad None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.136817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d1ccb-dbb1-4c4d-b807-ae303012c488 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.139338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d1ccb-dbb1-4c4d-b807-ae303012c488 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.146324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de67127-38a1-47ea-ac48-235349ed59ad None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.148636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 333/655] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:29.151413 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf064d1-d6d1-4a81-8973-d8d91c5162c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.152295 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf064d1-d6d1-4a81-8973-d8d91c5162c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.152771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf064d1-d6d1-4a81-8973-d8d91c5162c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.153576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf064d1-d6d1-4a81-8973-d8d91c5162c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.154409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1ccb-dbb1-4c4d-b807-ae303012c488 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.154788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf064d1-d6d1-4a81-8973-d8d91c5162c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.155288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf064d1-d6d1-4a81-8973-d8d91c5162c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.157079 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf064d1-d6d1-4a81-8973-d8d91c5162c6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.164178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1ccb-dbb1-4c4d-b807-ae303012c488 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.168854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ee460-3cf7-4b7e-b619-c402bd5f13c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.169654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ee460-3cf7-4b7e-b619-c402bd5f13c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.169962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ee460-3cf7-4b7e-b619-c402bd5f13c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.170554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ee460-3cf7-4b7e-b619-c402bd5f13c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.172125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 323/656] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:29.173224 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf064d1-d6d1-4a81-8973-d8d91c5162c6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.183656 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf064d1-d6d1-4a81-8973-d8d91c5162c6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.187452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ee460-3cf7-4b7e-b619-c402bd5f13c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.188998 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f0e4f-f522-4eda-b023-d80ec0f78e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.189269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ee460-3cf7-4b7e-b619-c402bd5f13c3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.190444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f0e4f-f522-4eda-b023-d80ec0f78e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.190938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f0e4f-f522-4eda-b023-d80ec0f78e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.191403 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f0e4f-f522-4eda-b023-d80ec0f78e2b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.202347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f0e4f-f522-4eda-b023-d80ec0f78e2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:29.207501 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-ff9ee460-3cf7-4b7e-b619-c402bd5f13c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:29.208874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 334/657] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:29.209450 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ee460-3cf7-4b7e-b619-c402bd5f13c3 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.210568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-9b0f0e4f-f522-4eda-b023-d80ec0f78e2b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:29.212278 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 324/658] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:29.215590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f0e4f-f522-4eda-b023-d80ec0f78e2b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.224777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ee460-3cf7-4b7e-b619-c402bd5f13c3 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.228514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f0e4f-f522-4eda-b023-d80ec0f78e2b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.230456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a6f47-ffa7-47eb-a07b-9169b6472f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.232029 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a6f47-ffa7-47eb-a07b-9169b6472f07 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.232307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a6f47-ffa7-47eb-a07b-9169b6472f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.232578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a6f47-ffa7-47eb-a07b-9169b6472f07 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.236039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ddb9b-9267-4754-b59b-a1edd2f06722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.237120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ddb9b-9267-4754-b59b-a1edd2f06722 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.237551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ddb9b-9267-4754-b59b-a1edd2f06722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.238023 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ddb9b-9267-4754-b59b-a1edd2f06722 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.238610 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ddb9b-9267-4754-b59b-a1edd2f06722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.238913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ddb9b-9267-4754-b59b-a1edd2f06722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.240507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ddb9b-9267-4754-b59b-a1edd2f06722 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.243322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a6f47-ffa7-47eb-a07b-9169b6472f07 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.245232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a6f47-ffa7-47eb-a07b-9169b6472f07 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.257228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 325/659] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:29.258163 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ddb9b-9267-4754-b59b-a1edd2f06722 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.260123 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-066a6f47-ffa7-47eb-a07b-9169b6472f07 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:29.261532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 335/660] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:29.267579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a6f47-ffa7-47eb-a07b-9169b6472f07 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.268174 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ddb9b-9267-4754-b59b-a1edd2f06722 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.273334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32e2da-ba75-491d-a908-8d39ec77945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.274036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e2da-ba75-491d-a908-8d39ec77945d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.274460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e2da-ba75-491d-a908-8d39ec77945d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.274565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e2da-ba75-491d-a908-8d39ec77945d admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.275328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32e2da-ba75-491d-a908-8d39ec77945d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.275631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32e2da-ba75-491d-a908-8d39ec77945d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.277197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32e2da-ba75-491d-a908-8d39ec77945d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.280280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a6f47-ffa7-47eb-a07b-9169b6472f07 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.285713 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7cb9b-c7d0-4051-98e3-a27e0e18f3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.286433 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7cb9b-c7d0-4051-98e3-a27e0e18f3ca admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.286752 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7cb9b-c7d0-4051-98e3-a27e0e18f3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.286899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 326/661] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:29.286992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7cb9b-c7d0-4051-98e3-a27e0e18f3ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.287807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7cb9b-c7d0-4051-98e3-a27e0e18f3ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.288628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7cb9b-c7d0-4051-98e3-a27e0e18f3ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.288865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32e2da-ba75-491d-a908-8d39ec77945d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.290482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7cb9b-c7d0-4051-98e3-a27e0e18f3ca admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.299601 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32e2da-ba75-491d-a908-8d39ec77945d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.303951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 336/662] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:29.309778 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7cb9b-c7d0-4051-98e3-a27e0e18f3ca admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.313925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfabe6-0ece-42bf-b808-d61ff5774981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.315165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfabe6-0ece-42bf-b808-d61ff5774981 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.316131 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfabe6-0ece-42bf-b808-d61ff5774981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.316576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfabe6-0ece-42bf-b808-d61ff5774981 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.319823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7cb9b-c7d0-4051-98e3-a27e0e18f3ca admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.325081 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfabe6-0ece-42bf-b808-d61ff5774981 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.325344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc3f95-c11c-46f3-a4f1-4b4bd385e4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.326300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3f95-c11c-46f3-a4f1-4b4bd385e4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.326685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3f95-c11c-46f3-a4f1-4b4bd385e4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.327121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3f95-c11c-46f3-a4f1-4b4bd385e4e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.328069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfabe6-0ece-42bf-b808-d61ff5774981 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.340689 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc3f95-c11c-46f3-a4f1-4b4bd385e4e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.342719 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc3f95-c11c-46f3-a4f1-4b4bd385e4e6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.345102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-9cdfabe6-0ece-42bf-b808-d61ff5774981 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:29.347142 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 327/663] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:29.353503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfabe6-0ece-42bf-b808-d61ff5774981 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.365086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfabe6-0ece-42bf-b808-d61ff5774981 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.365644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-18dc3f95-c11c-46f3-a4f1-4b4bd385e4e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:29.367495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 337/664] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:29.368415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc3f95-c11c-46f3-a4f1-4b4bd385e4e6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.375758 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1696ea-5170-41e6-8929-d25ae75c126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.376558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1696ea-5170-41e6-8929-d25ae75c126f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.376963 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1696ea-5170-41e6-8929-d25ae75c126f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.377363 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1696ea-5170-41e6-8929-d25ae75c126f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.378353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1696ea-5170-41e6-8929-d25ae75c126f admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=63a5db2990424915ac1daf36d14a733b) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.378795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1696ea-5170-41e6-8929-d25ae75c126f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.380802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1696ea-5170-41e6-8929-d25ae75c126f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.383531 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc3f95-c11c-46f3-a4f1-4b4bd385e4e6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.387844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 328/665] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/role_assignments?user.id=63a5db2990424915ac1daf36d14a733b&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:29.389803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f248137-79ce-467e-8bfa-e386b356aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.389948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1696ea-5170-41e6-8929-d25ae75c126f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.390754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f248137-79ce-467e-8bfa-e386b356aacd admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.391138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f248137-79ce-467e-8bfa-e386b356aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.391517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f248137-79ce-467e-8bfa-e386b356aacd admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.392565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f248137-79ce-467e-8bfa-e386b356aacd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.392981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f248137-79ce-467e-8bfa-e386b356aacd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.395144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f248137-79ce-467e-8bfa-e386b356aacd admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.412466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1696ea-5170-41e6-8929-d25ae75c126f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.423720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6af6a-86d3-4530-8256-3222d23971ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.424655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6af6a-86d3-4530-8256-3222d23971ea admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.425565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6af6a-86d3-4530-8256-3222d23971ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.426581 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6af6a-86d3-4530-8256-3222d23971ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.427498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6af6a-86d3-4530-8256-3222d23971ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.428601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 338/666] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:29.429061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6af6a-86d3-4530-8256-3222d23971ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.430969 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6af6a-86d3-4530-8256-3222d23971ea admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.435577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f248137-79ce-467e-8bfa-e386b356aacd admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.452010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f248137-79ce-467e-8bfa-e386b356aacd admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.458161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 329/667] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:29.466496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6af6a-86d3-4530-8256-3222d23971ea admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.470188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276813fe-1c92-4146-815d-7be4a79b7f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.470932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276813fe-1c92-4146-815d-7be4a79b7f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.471212 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276813fe-1c92-4146-815d-7be4a79b7f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.471486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276813fe-1c92-4146-815d-7be4a79b7f2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.474342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276813fe-1c92-4146-815d-7be4a79b7f2f admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=de1632f6a5414d2abfdee3b5bdd941cd) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.474984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276813fe-1c92-4146-815d-7be4a79b7f2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.479258 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276813fe-1c92-4146-815d-7be4a79b7f2f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.489222 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6af6a-86d3-4530-8256-3222d23971ea admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.493855 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 339/668] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/role_assignments?user.id=de1632f6a5414d2abfdee3b5bdd941cd&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:29.496525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082c393-b9ae-4016-8342-2072113a3dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.497425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082c393-b9ae-4016-8342-2072113a3dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.497708 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082c393-b9ae-4016-8342-2072113a3dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.498100 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082c393-b9ae-4016-8342-2072113a3dbf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.508337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082c393-b9ae-4016-8342-2072113a3dbf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.510426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082c393-b9ae-4016-8342-2072113a3dbf admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.526089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-1082c393-b9ae-4016-8342-2072113a3dbf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:24:29.532683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 330/669] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:29.534127 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276813fe-1c92-4146-815d-7be4a79b7f2f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.544845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276813fe-1c92-4146-815d-7be4a79b7f2f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.549587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a8e3a-2b27-4943-b6f5-efe3f9a8539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.550417 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a8e3a-2b27-4943-b6f5-efe3f9a8539c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.550700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a8e3a-2b27-4943-b6f5-efe3f9a8539c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.550971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a8e3a-2b27-4943-b6f5-efe3f9a8539c admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.551893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a8e3a-2b27-4943-b6f5-efe3f9a8539c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.552200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a8e3a-2b27-4943-b6f5-efe3f9a8539c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.554319 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a8e3a-2b27-4943-b6f5-efe3f9a8539c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.575092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 340/670] 10.222.0.83 () {56 vars in 1156 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:29.581684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082c393-b9ae-4016-8342-2072113a3dbf admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.592650 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082c393-b9ae-4016-8342-2072113a3dbf admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.597350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc023a4-a703-4eb3-9f6f-6c2ddfa3e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.598194 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc023a4-a703-4eb3-9f6f-6c2ddfa3e4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.598474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc023a4-a703-4eb3-9f6f-6c2ddfa3e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.598747 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc023a4-a703-4eb3-9f6f-6c2ddfa3e4fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.611941 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc023a4-a703-4eb3-9f6f-6c2ddfa3e4fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.613870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc023a4-a703-4eb3-9f6f-6c2ddfa3e4fb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.632482 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-8fc023a4-a703-4eb3-9f6f-6c2ddfa3e4fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:29.637165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 331/671] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:29.640548 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a8e3a-2b27-4943-b6f5-efe3f9a8539c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.651334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a8e3a-2b27-4943-b6f5-efe3f9a8539c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.655914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987e209-a112-4cc0-86db-6498f936721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.656595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987e209-a112-4cc0-86db-6498f936721e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.656876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987e209-a112-4cc0-86db-6498f936721e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.657151 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987e209-a112-4cc0-86db-6498f936721e admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.657946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987e209-a112-4cc0-86db-6498f936721e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.658329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987e209-a112-4cc0-86db-6498f936721e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.660017 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987e209-a112-4cc0-86db-6498f936721e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.677944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 341/672] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:29.679651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc023a4-a703-4eb3-9f6f-6c2ddfa3e4fb admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.690757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc023a4-a703-4eb3-9f6f-6c2ddfa3e4fb admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.696175 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53ca39-5106-4481-9bbb-aa842866b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.697036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53ca39-5106-4481-9bbb-aa842866b417 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.697315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53ca39-5106-4481-9bbb-aa842866b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.697587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53ca39-5106-4481-9bbb-aa842866b417 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.708775 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53ca39-5106-4481-9bbb-aa842866b417 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.711419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53ca39-5106-4481-9bbb-aa842866b417 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.727330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-4e53ca39-5106-4481-9bbb-aa842866b417 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:29.732535 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 332/673] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:29.735634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987e209-a112-4cc0-86db-6498f936721e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.746188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987e209-a112-4cc0-86db-6498f936721e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.755375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c916115-0b58-4c47-b739-2c97af142a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.756062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916115-0b58-4c47-b739-2c97af142a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.756339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916115-0b58-4c47-b739-2c97af142a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.757145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916115-0b58-4c47-b739-2c97af142a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.757997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c916115-0b58-4c47-b739-2c97af142a25 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:29.758305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c916115-0b58-4c47-b739-2c97af142a25 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.760170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c916115-0b58-4c47-b739-2c97af142a25 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.782704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 342/674] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:29.789034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53ca39-5106-4481-9bbb-aa842866b417 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:29.800300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53ca39-5106-4481-9bbb-aa842866b417 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:29.807917 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc6dba-01fc-40ef-a1e7-b821a8d43768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:29.808890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc6dba-01fc-40ef-a1e7-b821a8d43768 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:29.809466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc6dba-01fc-40ef-a1e7-b821a8d43768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:29.809741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc6dba-01fc-40ef-a1e7-b821a8d43768 admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/93ec8ea8a0904d30b6a95c8ebc9dd634/roles/35803c6179744bf1933e2b30b362f87d` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:29.827808 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc6dba-01fc-40ef-a1e7-b821a8d43768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=93ec8ea8a0904d30b6a95c8ebc9dd634, role_id=35803c6179744bf1933e2b30b362f87d)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:29.830550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc6dba-01fc-40ef-a1e7-b821a8d43768 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:29.858022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 333/675] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:24:29 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/93ec8ea8a0904d30b6a95c8ebc9dd634/roles/35803c6179744bf1933e2b30b362f87d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:30.911253 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70abc6-6457-4aea-83e7-38b7e3dd5978 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:30.911913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70abc6-6457-4aea-83e7-38b7e3dd5978 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:30.911913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70abc6-6457-4aea-83e7-38b7e3dd5978 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:30.913817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 343/676] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:30.919846 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d1019-8007-40fa-bcd2-eebf961af2f5 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:30.920394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d1019-8007-40fa-bcd2-eebf961af2f5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:30.920394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d1019-8007-40fa-bcd2-eebf961af2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:30.946835 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-475d1019-8007-40fa-bcd2-eebf961af2f5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:30.948065 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-475d1019-8007-40fa-bcd2-eebf961af2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:31.027491 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 334/677] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:31.073699 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70abc6-6457-4aea-83e7-38b7e3dd5978 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.087228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70abc6-6457-4aea-83e7-38b7e3dd5978 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.099167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c178c-529b-46e0-90e9-87820ba9a9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.099167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c178c-529b-46e0-90e9-87820ba9a9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.099167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c178c-529b-46e0-90e9-87820ba9a9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.099167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c178c-529b-46e0-90e9-87820ba9a9f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.122985 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c178c-529b-46e0-90e9-87820ba9a9f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:31.130269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-7b2c178c-529b-46e0-90e9-87820ba9a9f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:24:31.132297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 344/678] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:31.138689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d1019-8007-40fa-bcd2-eebf961af2f5 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.153955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d1019-8007-40fa-bcd2-eebf961af2f5 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.164898 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c1ca5-b767-4307-bd34-8370770922dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.165513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c1ca5-b767-4307-bd34-8370770922dc admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.165820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c1ca5-b767-4307-bd34-8370770922dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.166103 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c1ca5-b767-4307-bd34-8370770922dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.166885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c1ca5-b767-4307-bd34-8370770922dc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:31.167196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c1ca5-b767-4307-bd34-8370770922dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:31.168791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c1ca5-b767-4307-bd34-8370770922dc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:31.188350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 335/679] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:31.194293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c178c-529b-46e0-90e9-87820ba9a9f8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.206804 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c178c-529b-46e0-90e9-87820ba9a9f8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.216434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e04d24-b2ab-4119-8212-30b77c4f782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.217509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04d24-b2ab-4119-8212-30b77c4f782c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.218044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04d24-b2ab-4119-8212-30b77c4f782c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.218564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04d24-b2ab-4119-8212-30b77c4f782c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.237587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e04d24-b2ab-4119-8212-30b77c4f782c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:31.239758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e04d24-b2ab-4119-8212-30b77c4f782c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:31.266565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-17e04d24-b2ab-4119-8212-30b77c4f782c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:31.268139 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 345/680] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:31.274252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c1ca5-b767-4307-bd34-8370770922dc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.292286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c1ca5-b767-4307-bd34-8370770922dc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.301351 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eee0a-2f4a-435c-9cd9-a5eb2467948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.302043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eee0a-2f4a-435c-9cd9-a5eb2467948c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.302319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eee0a-2f4a-435c-9cd9-a5eb2467948c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.302588 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eee0a-2f4a-435c-9cd9-a5eb2467948c admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.303324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eee0a-2f4a-435c-9cd9-a5eb2467948c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:31.303680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eee0a-2f4a-435c-9cd9-a5eb2467948c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:31.305263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eee0a-2f4a-435c-9cd9-a5eb2467948c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:31.324937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 336/681] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:31.330629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e04d24-b2ab-4119-8212-30b77c4f782c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.347267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e04d24-b2ab-4119-8212-30b77c4f782c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.358217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d39db-7443-43ea-915d-dfa0f04ea344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.359398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d39db-7443-43ea-915d-dfa0f04ea344 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.359886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d39db-7443-43ea-915d-dfa0f04ea344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.360383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d39db-7443-43ea-915d-dfa0f04ea344 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.378995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d39db-7443-43ea-915d-dfa0f04ea344 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:31.381385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d39db-7443-43ea-915d-dfa0f04ea344 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:31.399630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-334d39db-7443-43ea-915d-dfa0f04ea344 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:24:31.401136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 346/682] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:31.407461 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eee0a-2f4a-435c-9cd9-a5eb2467948c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.423001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eee0a-2f4a-435c-9cd9-a5eb2467948c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.432741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29132e73-4837-4cf6-9cf7-c7b876c1ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.433416 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29132e73-4837-4cf6-9cf7-c7b876c1ad6b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.433698 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29132e73-4837-4cf6-9cf7-c7b876c1ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.433987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29132e73-4837-4cf6-9cf7-c7b876c1ad6b admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.435106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29132e73-4837-4cf6-9cf7-c7b876c1ad6b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:31.435406 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29132e73-4837-4cf6-9cf7-c7b876c1ad6b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:31.437235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29132e73-4837-4cf6-9cf7-c7b876c1ad6b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:31.465223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 337/683] 10.222.0.83 () {56 vars in 1154 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:31.470788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d39db-7443-43ea-915d-dfa0f04ea344 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.486988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d39db-7443-43ea-915d-dfa0f04ea344 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.497972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36a866-c37c-4edb-966a-ab1ce21dead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.498956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a866-c37c-4edb-966a-ab1ce21dead5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.499442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a866-c37c-4edb-966a-ab1ce21dead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.499936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a866-c37c-4edb-966a-ab1ce21dead5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.511111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36a866-c37c-4edb-966a-ab1ce21dead5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:31.513031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36a866-c37c-4edb-966a-ab1ce21dead5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:31.528419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 347/684] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:31.534396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29132e73-4837-4cf6-9cf7-c7b876c1ad6b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.546622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29132e73-4837-4cf6-9cf7-c7b876c1ad6b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.557466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411977c3-c057-4d72-b313-b5172179cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.558305 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411977c3-c057-4d72-b313-b5172179cb4e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.558617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411977c3-c057-4d72-b313-b5172179cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.558891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411977c3-c057-4d72-b313-b5172179cb4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.571791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411977c3-c057-4d72-b313-b5172179cb4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:31.573603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411977c3-c057-4d72-b313-b5172179cb4e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:31.595622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-411977c3-c057-4d72-b313-b5172179cb4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:31.597117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 338/685] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:31.602733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36a866-c37c-4edb-966a-ab1ce21dead5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.614902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36a866-c37c-4edb-966a-ab1ce21dead5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.623912 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508707c-d1ba-4481-a410-6a9bc34cc435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.624626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508707c-d1ba-4481-a410-6a9bc34cc435 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.625010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508707c-d1ba-4481-a410-6a9bc34cc435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.625293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508707c-d1ba-4481-a410-6a9bc34cc435 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.626061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508707c-d1ba-4481-a410-6a9bc34cc435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:31.626368 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508707c-d1ba-4481-a410-6a9bc34cc435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:31.628010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508707c-d1ba-4481-a410-6a9bc34cc435 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:31.645698 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 348/686] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:31.659058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411977c3-c057-4d72-b313-b5172179cb4e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.670759 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411977c3-c057-4d72-b313-b5172179cb4e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.677876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1f0ee-0da1-4025-ab31-2eba0aea9be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.679121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1f0ee-0da1-4025-ab31-2eba0aea9be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.679431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1f0ee-0da1-4025-ab31-2eba0aea9be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.679714 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1f0ee-0da1-4025-ab31-2eba0aea9be4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.695417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1f0ee-0da1-4025-ab31-2eba0aea9be4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:31.697373 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1f0ee-0da1-4025-ab31-2eba0aea9be4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:31.716538 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-8ee1f0ee-0da1-4025-ab31-2eba0aea9be4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:31.722073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 339/687] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:31.724173 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508707c-d1ba-4481-a410-6a9bc34cc435 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.743355 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508707c-d1ba-4481-a410-6a9bc34cc435 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.750030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3bfd3-ac98-45a4-ad46-aa140d867d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.750806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3bfd3-ac98-45a4-ad46-aa140d867d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.751092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3bfd3-ac98-45a4-ad46-aa140d867d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.751372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3bfd3-ac98-45a4-ad46-aa140d867d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.752225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3bfd3-ac98-45a4-ad46-aa140d867d7b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:31.752538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3bfd3-ac98-45a4-ad46-aa140d867d7b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:31.754504 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3bfd3-ac98-45a4-ad46-aa140d867d7b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:31.775500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 349/688] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:31.781356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1f0ee-0da1-4025-ab31-2eba0aea9be4 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.794652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1f0ee-0da1-4025-ab31-2eba0aea9be4 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.806409 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33408e90-4060-4b82-9a71-81a96868e8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.807071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33408e90-4060-4b82-9a71-81a96868e8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.807349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33408e90-4060-4b82-9a71-81a96868e8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.807624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33408e90-4060-4b82-9a71-81a96868e8c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.808479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33408e90-4060-4b82-9a71-81a96868e8c2 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=a34b3d2f67b1477598acce389819c70a) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:31.808791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33408e90-4060-4b82-9a71-81a96868e8c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:31.810935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33408e90-4060-4b82-9a71-81a96868e8c2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:31.817129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 340/689] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/role_assignments?user.id=a34b3d2f67b1477598acce389819c70a&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=a312b345efeb490eb4234d1ace386dec => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:31.866544 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbcb10-6ae1-46e7-9a64-6f436de239ee None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.866857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbcb10-6ae1-46e7-9a64-6f436de239ee None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.867098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbcb10-6ae1-46e7-9a64-6f436de239ee None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.869117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 350/690] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:31.875565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88043f-0f98-49df-a6a5-8067f491b006 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.875886 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88043f-0f98-49df-a6a5-8067f491b006 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.876117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88043f-0f98-49df-a6a5-8067f491b006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:31.903029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-be88043f-0f98-49df-a6a5-8067f491b006 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:31.904253 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-be88043f-0f98-49df-a6a5-8067f491b006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:31.912518 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 341/691] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:31.959361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbcb10-6ae1-46e7-9a64-6f436de239ee None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:31.977038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbcb10-6ae1-46e7-9a64-6f436de239ee None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:31.982964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080cacc-e871-4845-a54a-80688979e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:31.983784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080cacc-e871-4845-a54a-80688979e3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:31.984068 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080cacc-e871-4845-a54a-80688979e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:31.984598 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080cacc-e871-4845-a54a-80688979e3a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.000914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080cacc-e871-4845-a54a-80688979e3a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:32.002888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080cacc-e871-4845-a54a-80688979e3a2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:32.026534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-2080cacc-e871-4845-a54a-80688979e3a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:32.032567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 351/692] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:32.034412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88043f-0f98-49df-a6a5-8067f491b006 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:32.047917 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88043f-0f98-49df-a6a5-8067f491b006 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:32.062543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831df79-86a2-40fa-958f-7901fbb94b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:32.063240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831df79-86a2-40fa-958f-7901fbb94b97 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.063520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831df79-86a2-40fa-958f-7901fbb94b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.063795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831df79-86a2-40fa-958f-7901fbb94b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.064551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831df79-86a2-40fa-958f-7901fbb94b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:32.064858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831df79-86a2-40fa-958f-7901fbb94b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:32.066501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831df79-86a2-40fa-958f-7901fbb94b97 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:32.083396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 342/693] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:32.089138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080cacc-e871-4845-a54a-80688979e3a2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:32.103179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080cacc-e871-4845-a54a-80688979e3a2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:32.111648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007defa4-06d4-48e8-ad18-49c236b44385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:32.112411 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007defa4-06d4-48e8-ad18-49c236b44385 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.112737 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007defa4-06d4-48e8-ad18-49c236b44385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.113019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007defa4-06d4-48e8-ad18-49c236b44385 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.113844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007defa4-06d4-48e8-ad18-49c236b44385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:32.115894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007defa4-06d4-48e8-ad18-49c236b44385 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:32.154729 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 352/694] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:24:32 2021] POST /identity/v3/users => generated 254 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:32.611235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711275d-ceb5-4e6a-8327-8bd57718847b None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.611613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711275d-ceb5-4e6a-8327-8bd57718847b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.611784 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711275d-ceb5-4e6a-8327-8bd57718847b None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.613884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 343/695] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:32.620367 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2fd1b-248b-4747-b2f6-d790ba17518d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.620677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2fd1b-248b-4747-b2f6-d790ba17518d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.620936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2fd1b-248b-4747-b2f6-d790ba17518d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.659301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb381f7-4688-4299-ae33-e8bd467a3e6c None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.659301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb381f7-4688-4299-ae33-e8bd467a3e6c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.659301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb381f7-4688-4299-ae33-e8bd467a3e6c None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.659642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-bef2fd1b-248b-4747-b2f6-d790ba17518d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:32.660749 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 344/696] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:32.661147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bef2fd1b-248b-4747-b2f6-d790ba17518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:32.667326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7479f-822b-4732-93ad-6faa570b0bb6 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.667703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7479f-822b-4732-93ad-6faa570b0bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.667985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7479f-822b-4732-93ad-6faa570b0bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.676076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 353/697] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:32.687721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b6a7479f-822b-4732-93ad-6faa570b0bb6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:32.688910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b6a7479f-822b-4732-93ad-6faa570b0bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:32.698149 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 345/698] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:32.699751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2fd1b-248b-4747-b2f6-d790ba17518d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:32.712540 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2fd1b-248b-4747-b2f6-d790ba17518d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:32.722331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1c9c9-5087-4058-a97d-358b6e1b4078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:32.722833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7479f-822b-4732-93ad-6faa570b0bb6 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:32.723160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c9c9-5087-4058-a97d-358b6e1b4078 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.723436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c9c9-5087-4058-a97d-358b6e1b4078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.723708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c9c9-5087-4058-a97d-358b6e1b4078 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.724385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1c9c9-5087-4058-a97d-358b6e1b4078 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:32.725440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-c1d1c9c9-5087-4058-a97d-358b6e1b4078 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:32.725440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:24:32.725440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:24:32.726387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1c9c9-5087-4058-a97d-358b6e1b4078 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:32.734367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7479f-822b-4732-93ad-6faa570b0bb6 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:32.739630 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf34ddd-2522-4cf9-a882-0381d535f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:32.740454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf34ddd-2522-4cf9-a882-0381d535f544 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.740732 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf34ddd-2522-4cf9-a882-0381d535f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.741046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf34ddd-2522-4cf9-a882-0381d535f544 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.741727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf34ddd-2522-4cf9-a882-0381d535f544 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:32.742778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-9cf34ddd-2522-4cf9-a882-0381d535f544 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:32.742778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:24:32.742778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:24:32.743656 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf34ddd-2522-4cf9-a882-0381d535f544 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:32.748331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-c1d1c9c9-5087-4058-a97d-358b6e1b4078 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 13:24:32.753794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 354/699] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:32 2021] GET /identity/v3/services/network => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:32.756244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1c9c9-5087-4058-a97d-358b6e1b4078 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:32.763201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-9cf34ddd-2522-4cf9-a882-0381d535f544 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 13:24:32.764918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 346/700] 10.222.0.83 () {56 vars in 1150 bytes} [Wed Dec 15 13:24:32 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:32.767295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1c9c9-5087-4058-a97d-358b6e1b4078 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:32.772045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf34ddd-2522-4cf9-a882-0381d535f544 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:32.773298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca408b41-adb9-440e-bd31-c56d1792267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:32.774239 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca408b41-adb9-440e-bd31-c56d1792267a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.774750 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca408b41-adb9-440e-bd31-c56d1792267a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.775234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca408b41-adb9-440e-bd31-c56d1792267a admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.776166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca408b41-adb9-440e-bd31-c56d1792267a admin admin] RBAC: Adding query filter params (name=network) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:32.776679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca408b41-adb9-440e-bd31-c56d1792267a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:32.777929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-ca408b41-adb9-440e-bd31-c56d1792267a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:32.777929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:24:32.777929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:24:32.779222 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca408b41-adb9-440e-bd31-c56d1792267a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:32.782881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf34ddd-2522-4cf9-a882-0381d535f544 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:32.784837 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 355/701] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:24:32 2021] GET /identity/v3/services?name=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:32.787411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b63e2-f1cd-4330-91c5-cb7e87037351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:32.788655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b63e2-f1cd-4330-91c5-cb7e87037351 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.788930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b63e2-f1cd-4330-91c5-cb7e87037351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.789258 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b63e2-f1cd-4330-91c5-cb7e87037351 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.790001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b63e2-f1cd-4330-91c5-cb7e87037351 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:32.790303 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b63e2-f1cd-4330-91c5-cb7e87037351 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:32.791369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-7f7b63e2-f1cd-4330-91c5-cb7e87037351 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:32.791369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:24:32.791369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:24:32.792513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b63e2-f1cd-4330-91c5-cb7e87037351 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:32.793511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca408b41-adb9-440e-bd31-c56d1792267a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:32.802097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 347/702] 10.222.0.83 () {56 vars in 1145 bytes} [Wed Dec 15 13:24:32 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:32.804583 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b63e2-f1cd-4330-91c5-cb7e87037351 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:32.805045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca408b41-adb9-440e-bd31-c56d1792267a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:32.810110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b2d1c-51cd-4729-ba36-46c7ec0540d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:32.811023 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b2d1c-51cd-4729-ba36-46c7ec0540d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.811548 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b2d1c-51cd-4729-ba36-46c7ec0540d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.812060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b2d1c-51cd-4729-ba36-46c7ec0540d1 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.813006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b2d1c-51cd-4729-ba36-46c7ec0540d1 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:32.813649 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b2d1c-51cd-4729-ba36-46c7ec0540d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:32.816029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b63e2-f1cd-4330-91c5-cb7e87037351 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:32.816975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b2d1c-51cd-4729-ba36-46c7ec0540d1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:32.822868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3dbdc-9ab5-42d1-8703-963d0b10fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:32.823551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3dbdc-9ab5-42d1-8703-963d0b10fb78 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:32.823948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3dbdc-9ab5-42d1-8703-963d0b10fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:32.824342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3dbdc-9ab5-42d1-8703-963d0b10fb78 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:32.825436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3dbdc-9ab5-42d1-8703-963d0b10fb78 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:32.825675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 356/703] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:24:32 2021] GET /identity/v3/services?type=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:32.825809 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3dbdc-9ab5-42d1-8703-963d0b10fb78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:32.829859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3dbdc-9ab5-42d1-8703-963d0b10fb78 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:32.836163 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 348/704] 10.222.0.83 () {56 vars in 1145 bytes} [Wed Dec 15 13:24:32 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:33.166830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfc85f-7266-4484-b92a-17872695b308 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.167834 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfc85f-7266-4484-b92a-17872695b308 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.168338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfc85f-7266-4484-b92a-17872695b308 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.170631 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 357/705] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:33.177438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41104-6e70-4156-b12b-2bf3e0c3b41c None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.177941 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41104-6e70-4156-b12b-2bf3e0c3b41c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.178038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41104-6e70-4156-b12b-2bf3e0c3b41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.199792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-a6d41104-6e70-4156-b12b-2bf3e0c3b41c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:33.200991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a6d41104-6e70-4156-b12b-2bf3e0c3b41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:33.209044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 349/706] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:33.235104 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfc85f-7266-4484-b92a-17872695b308 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:33.251579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfc85f-7266-4484-b92a-17872695b308 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:33.256502 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23c12b-fa6d-4041-a495-ff1508b296c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:33.257775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23c12b-fa6d-4041-a495-ff1508b296c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.258275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23c12b-fa6d-4041-a495-ff1508b296c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.258720 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23c12b-fa6d-4041-a495-ff1508b296c6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.271412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23c12b-fa6d-4041-a495-ff1508b296c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:33.279366 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-7f23c12b-fa6d-4041-a495-ff1508b296c6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:33.285892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 358/707] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:33.289008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d41104-6e70-4156-b12b-2bf3e0c3b41c None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:33.298523 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d41104-6e70-4156-b12b-2bf3e0c3b41c None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:33.303502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3ab9b-5e4e-4197-8385-2e6dee414dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:33.304430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3ab9b-5e4e-4197-8385-2e6dee414dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.304881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3ab9b-5e4e-4197-8385-2e6dee414dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.305323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3ab9b-5e4e-4197-8385-2e6dee414dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.306296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3ab9b-5e4e-4197-8385-2e6dee414dc5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:33.306796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3ab9b-5e4e-4197-8385-2e6dee414dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:33.308562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3ab9b-5e4e-4197-8385-2e6dee414dc5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:33.326128 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 350/708] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:33.333034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23c12b-fa6d-4041-a495-ff1508b296c6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:33.354764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23c12b-fa6d-4041-a495-ff1508b296c6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:33.366600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c06f9a-6d03-4308-83d2-4bded2e1ab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:33.367433 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c06f9a-6d03-4308-83d2-4bded2e1ab80 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.367712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c06f9a-6d03-4308-83d2-4bded2e1ab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.367983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c06f9a-6d03-4308-83d2-4bded2e1ab80 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.388002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c06f9a-6d03-4308-83d2-4bded2e1ab80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:33.390587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c06f9a-6d03-4308-83d2-4bded2e1ab80 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:33.414484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-92c06f9a-6d03-4308-83d2-4bded2e1ab80 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:33.416096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 359/709] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:33.422579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3ab9b-5e4e-4197-8385-2e6dee414dc5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:33.435420 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3ab9b-5e4e-4197-8385-2e6dee414dc5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:33.452187 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ee855-ede5-4d37-90ba-e9391d2e205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:33.452880 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ee855-ede5-4d37-90ba-e9391d2e205b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.453166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ee855-ede5-4d37-90ba-e9391d2e205b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.453446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ee855-ede5-4d37-90ba-e9391d2e205b admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.454241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ee855-ede5-4d37-90ba-e9391d2e205b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:33.454549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ee855-ede5-4d37-90ba-e9391d2e205b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:33.456171 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ee855-ede5-4d37-90ba-e9391d2e205b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:33.479879 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 351/710] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:33.486270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c06f9a-6d03-4308-83d2-4bded2e1ab80 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:33.498435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c06f9a-6d03-4308-83d2-4bded2e1ab80 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:33.508906 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd70345-3274-48b6-a5d6-b832f50107d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:33.509789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70345-3274-48b6-a5d6-b832f50107d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.510093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70345-3274-48b6-a5d6-b832f50107d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.510370 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70345-3274-48b6-a5d6-b832f50107d1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.527201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd70345-3274-48b6-a5d6-b832f50107d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:33.529301 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd70345-3274-48b6-a5d6-b832f50107d1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:33.549177 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-afd70345-3274-48b6-a5d6-b832f50107d1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:24:33.550425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 360/711] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:33 2021] GET /identity/v3/users/swift => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:33.557345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ee855-ede5-4d37-90ba-e9391d2e205b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:33.581258 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ee855-ede5-4d37-90ba-e9391d2e205b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:33.595905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9eba3-5aef-41ac-8247-93146053b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:33.596933 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9eba3-5aef-41ac-8247-93146053b564 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.597369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9eba3-5aef-41ac-8247-93146053b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.597821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9eba3-5aef-41ac-8247-93146053b564 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.599218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9eba3-5aef-41ac-8247-93146053b564 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:33.599700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9eba3-5aef-41ac-8247-93146053b564 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:33.602914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9eba3-5aef-41ac-8247-93146053b564 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:33.663669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 352/712] 10.222.0.83 () {56 vars in 1156 bytes} [Wed Dec 15 13:24:33 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:33.669632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd70345-3274-48b6-a5d6-b832f50107d1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:33.688451 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd70345-3274-48b6-a5d6-b832f50107d1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:33.699044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bf7d9-a4e8-4f07-b7f9-9cfb5269a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:33.699715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf7d9-a4e8-4f07-b7f9-9cfb5269a77e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.700005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf7d9-a4e8-4f07-b7f9-9cfb5269a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.700287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf7d9-a4e8-4f07-b7f9-9cfb5269a77e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.714075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bf7d9-a4e8-4f07-b7f9-9cfb5269a77e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:33.715836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bf7d9-a4e8-4f07-b7f9-9cfb5269a77e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:33.731788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 361/713] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:33.741714 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9eba3-5aef-41ac-8247-93146053b564 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:33.761145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9eba3-5aef-41ac-8247-93146053b564 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:33.778793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac67590-f3d4-4183-a6eb-4fe47cb08076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:33.780069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67590-f3d4-4183-a6eb-4fe47cb08076 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.780500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67590-f3d4-4183-a6eb-4fe47cb08076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.780896 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67590-f3d4-4183-a6eb-4fe47cb08076 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.800810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac67590-f3d4-4183-a6eb-4fe47cb08076 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:33.804360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac67590-f3d4-4183-a6eb-4fe47cb08076 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:33.835931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-aac67590-f3d4-4183-a6eb-4fe47cb08076 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:33.837961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 353/714] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:33.843994 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bf7d9-a4e8-4f07-b7f9-9cfb5269a77e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:33.859154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bf7d9-a4e8-4f07-b7f9-9cfb5269a77e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:33.871476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba4b41-72f5-46fc-b91e-b62e315a33a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:33.872161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba4b41-72f5-46fc-b91e-b62e315a33a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.872444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba4b41-72f5-46fc-b91e-b62e315a33a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.872722 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba4b41-72f5-46fc-b91e-b62e315a33a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.873477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba4b41-72f5-46fc-b91e-b62e315a33a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:33.873806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba4b41-72f5-46fc-b91e-b62e315a33a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:33.875410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba4b41-72f5-46fc-b91e-b62e315a33a5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:33.894750 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 362/715] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:33.896052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac67590-f3d4-4183-a6eb-4fe47cb08076 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:33.911619 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac67590-f3d4-4183-a6eb-4fe47cb08076 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:33.921953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc46261-b115-4381-8419-80469aacdb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:33.922791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc46261-b115-4381-8419-80469aacdb65 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.923069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc46261-b115-4381-8419-80469aacdb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.923341 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc46261-b115-4381-8419-80469aacdb65 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:33.939827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc46261-b115-4381-8419-80469aacdb65 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:33.942311 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc46261-b115-4381-8419-80469aacdb65 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:33.970264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-4cc46261-b115-4381-8419-80469aacdb65 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:33.971593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 354/716] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:33.977888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba4b41-72f5-46fc-b91e-b62e315a33a5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:33.992909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba4b41-72f5-46fc-b91e-b62e315a33a5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:33.997743 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6d55c-f58c-4465-adfa-2b6af104c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:33.998666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6d55c-f58c-4465-adfa-2b6af104c374 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:33.999152 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6d55c-f58c-4465-adfa-2b6af104c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:33.999628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6d55c-f58c-4465-adfa-2b6af104c374 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:34.000655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6d55c-f58c-4465-adfa-2b6af104c374 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:34.001308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6d55c-f58c-4465-adfa-2b6af104c374 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:34.009782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6d55c-f58c-4465-adfa-2b6af104c374 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:34.025547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 363/717] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:34.032117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc46261-b115-4381-8419-80469aacdb65 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:34.049121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc46261-b115-4381-8419-80469aacdb65 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:34.057989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb475f1-d98f-4cf5-b0c0-bee2a7b21365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:34.058652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb475f1-d98f-4cf5-b0c0-bee2a7b21365 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:34.058928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb475f1-d98f-4cf5-b0c0-bee2a7b21365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:34.059442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb475f1-d98f-4cf5-b0c0-bee2a7b21365 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:34.060299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb475f1-d98f-4cf5-b0c0-bee2a7b21365 admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=93ec8ea8a0904d30b6a95c8ebc9dd634) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:34.060604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb475f1-d98f-4cf5-b0c0-bee2a7b21365 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:34.062478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb475f1-d98f-4cf5-b0c0-bee2a7b21365 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:34.070132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 355/718] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:34 2021] GET /identity/v3/role_assignments?user.id=93ec8ea8a0904d30b6a95c8ebc9dd634&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:34.833196 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90dcca-3cc2-427a-902d-22cba19d0a5e None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:34.834262 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90dcca-3cc2-427a-902d-22cba19d0a5e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:34.834812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90dcca-3cc2-427a-902d-22cba19d0a5e None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:34.837320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 364/719] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:34.843921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161bcf-0956-4f16-b7db-475f59a99de8 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:34.844913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161bcf-0956-4f16-b7db-475f59a99de8 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:34.845415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161bcf-0956-4f16-b7db-475f59a99de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:34.868695 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-27161bcf-0956-4f16-b7db-475f59a99de8 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:34.870242 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-27161bcf-0956-4f16-b7db-475f59a99de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:34.881851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 356/720] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:34.902643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90dcca-3cc2-427a-902d-22cba19d0a5e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:34.916475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90dcca-3cc2-427a-902d-22cba19d0a5e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:34.921023 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ce89b-896c-43b5-9673-b032f80d6b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:34.922077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ce89b-896c-43b5-9673-b032f80d6b78 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:34.922580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ce89b-896c-43b5-9673-b032f80d6b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:34.923084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ce89b-896c-43b5-9673-b032f80d6b78 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:34.938694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ce89b-896c-43b5-9673-b032f80d6b78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:34.945890 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-fb1ce89b-896c-43b5-9673-b032f80d6b78 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:24:34.952483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 365/721] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:34.954112 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161bcf-0956-4f16-b7db-475f59a99de8 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:34.963499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161bcf-0956-4f16-b7db-475f59a99de8 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:34.968231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53eab7-6ea5-43ba-9fcd-f537867763ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:34.969129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53eab7-6ea5-43ba-9fcd-f537867763ef admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:34.969620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53eab7-6ea5-43ba-9fcd-f537867763ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:34.970641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53eab7-6ea5-43ba-9fcd-f537867763ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:34.972189 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53eab7-6ea5-43ba-9fcd-f537867763ef admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:34.972696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53eab7-6ea5-43ba-9fcd-f537867763ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:34.974544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53eab7-6ea5-43ba-9fcd-f537867763ef admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:34.988900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 357/722] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:34.990517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ce89b-896c-43b5-9673-b032f80d6b78 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.001655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ce89b-896c-43b5-9673-b032f80d6b78 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.006349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7177f5-7300-4d14-947f-c6daa0b435a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.007401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7177f5-7300-4d14-947f-c6daa0b435a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.007903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7177f5-7300-4d14-947f-c6daa0b435a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.008378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7177f5-7300-4d14-947f-c6daa0b435a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.019529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7177f5-7300-4d14-947f-c6daa0b435a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.021665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7177f5-7300-4d14-947f-c6daa0b435a3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.039439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-1d7177f5-7300-4d14-947f-c6daa0b435a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:35.045886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 366/723] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:35.047522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53eab7-6ea5-43ba-9fcd-f537867763ef admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.057948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53eab7-6ea5-43ba-9fcd-f537867763ef admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.062926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d2444-b086-4bc7-9f19-df5132fd091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.063856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2444-b086-4bc7-9f19-df5132fd091b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.064350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2444-b086-4bc7-9f19-df5132fd091b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.064828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2444-b086-4bc7-9f19-df5132fd091b admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.065793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d2444-b086-4bc7-9f19-df5132fd091b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:35.066318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d2444-b086-4bc7-9f19-df5132fd091b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.068103 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d2444-b086-4bc7-9f19-df5132fd091b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.088178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 358/724] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:35.094283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7177f5-7300-4d14-947f-c6daa0b435a3 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.104741 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7177f5-7300-4d14-947f-c6daa0b435a3 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.109446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17acc60-c260-411d-b833-b5c902defdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.110506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17acc60-c260-411d-b833-b5c902defdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.110993 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17acc60-c260-411d-b833-b5c902defdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.111480 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17acc60-c260-411d-b833-b5c902defdd9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.119987 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17acc60-c260-411d-b833-b5c902defdd9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.122264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17acc60-c260-411d-b833-b5c902defdd9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.136501 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-c17acc60-c260-411d-b833-b5c902defdd9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:24:35.141852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 367/725] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:35.144565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d2444-b086-4bc7-9f19-df5132fd091b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.155463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d2444-b086-4bc7-9f19-df5132fd091b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.160284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb866dfc-507e-4d39-977d-5d91a7b688d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.161178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb866dfc-507e-4d39-977d-5d91a7b688d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.161734 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb866dfc-507e-4d39-977d-5d91a7b688d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.162238 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb866dfc-507e-4d39-977d-5d91a7b688d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.163926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb866dfc-507e-4d39-977d-5d91a7b688d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:35.164463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb866dfc-507e-4d39-977d-5d91a7b688d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.166694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb866dfc-507e-4d39-977d-5d91a7b688d3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.192613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 359/726] 10.222.0.83 () {56 vars in 1154 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:35.198976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17acc60-c260-411d-b833-b5c902defdd9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.209989 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17acc60-c260-411d-b833-b5c902defdd9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.215254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27f1fe-1b5c-4397-a1d1-300d24332f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.216356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27f1fe-1b5c-4397-a1d1-300d24332f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.217076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27f1fe-1b5c-4397-a1d1-300d24332f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.217583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27f1fe-1b5c-4397-a1d1-300d24332f2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.229472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27f1fe-1b5c-4397-a1d1-300d24332f2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.232319 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27f1fe-1b5c-4397-a1d1-300d24332f2f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.251625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-7d27f1fe-1b5c-4397-a1d1-300d24332f2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:35.257864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 368/727] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:35.259707 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb866dfc-507e-4d39-977d-5d91a7b688d3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.269920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb866dfc-507e-4d39-977d-5d91a7b688d3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.275311 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef9b2d-5ae1-4198-bfce-0abe12032039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.276255 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9b2d-5ae1-4198-bfce-0abe12032039 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.276761 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9b2d-5ae1-4198-bfce-0abe12032039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.277284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9b2d-5ae1-4198-bfce-0abe12032039 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.279829 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afc86-63c2-47b6-93b0-895f5ed11b96 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.280342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afc86-63c2-47b6-93b0-895f5ed11b96 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.280833 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afc86-63c2-47b6-93b0-895f5ed11b96 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.283234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 369/728] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:35.283696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef9b2d-5ae1-4198-bfce-0abe12032039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:35.284235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef9b2d-5ae1-4198-bfce-0abe12032039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.286465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef9b2d-5ae1-4198-bfce-0abe12032039 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.295782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb5c68-1608-4354-afa9-b68a1fc026a8 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.296484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb5c68-1608-4354-afa9-b68a1fc026a8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.297112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb5c68-1608-4354-afa9-b68a1fc026a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.322700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 360/729] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:35.327190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-94cb5c68-1608-4354-afa9-b68a1fc026a8 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:35.328934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-94cb5c68-1608-4354-afa9-b68a1fc026a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:35.339553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 370/730] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:35.340862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef9b2d-5ae1-4198-bfce-0abe12032039 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.351927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef9b2d-5ae1-4198-bfce-0abe12032039 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.356895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49975d4-8b82-4b19-bfec-30d28594cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.358060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49975d4-8b82-4b19-bfec-30d28594cea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.358560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49975d4-8b82-4b19-bfec-30d28594cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.359132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49975d4-8b82-4b19-bfec-30d28594cea6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.367312 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49975d4-8b82-4b19-bfec-30d28594cea6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.369572 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49975d4-8b82-4b19-bfec-30d28594cea6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.377207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb5c68-1608-4354-afa9-b68a1fc026a8 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.384406 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-a49975d4-8b82-4b19-bfec-30d28594cea6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:35.389868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 361/731] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:35.392504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49975d4-8b82-4b19-bfec-30d28594cea6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.396218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb5c68-1608-4354-afa9-b68a1fc026a8 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.403771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49975d4-8b82-4b19-bfec-30d28594cea6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.409102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c764e-7388-4bd6-8ad5-aeb0a2b20d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.410109 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c764e-7388-4bd6-8ad5-aeb0a2b20d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.410676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c764e-7388-4bd6-8ad5-aeb0a2b20d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.410984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38460a36-feb6-467b-aa36-9423ebdf5017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.411430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c764e-7388-4bd6-8ad5-aeb0a2b20d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.411798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460a36-feb6-467b-aa36-9423ebdf5017 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.412075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460a36-feb6-467b-aa36-9423ebdf5017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.412347 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460a36-feb6-467b-aa36-9423ebdf5017 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.413952 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c764e-7388-4bd6-8ad5-aeb0a2b20d51 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:35.414486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c764e-7388-4bd6-8ad5-aeb0a2b20d51 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.416782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c764e-7388-4bd6-8ad5-aeb0a2b20d51 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.435631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 362/732] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:35.439062 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c764e-7388-4bd6-8ad5-aeb0a2b20d51 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.450610 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c764e-7388-4bd6-8ad5-aeb0a2b20d51 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.450827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38460a36-feb6-467b-aa36-9423ebdf5017 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:35.455853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e760-b591-455f-9cc6-9822de8e80d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.457044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e760-b591-455f-9cc6-9822de8e80d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.457572 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e760-b591-455f-9cc6-9822de8e80d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.458114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e760-b591-455f-9cc6-9822de8e80d0 admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/a34b3d2f67b1477598acce389819c70a/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.460907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840e760-b591-455f-9cc6-9822de8e80d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=a34b3d2f67b1477598acce389819c70a, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.463919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840e760-b591-455f-9cc6-9822de8e80d0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.465932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-38460a36-feb6-467b-aa36-9423ebdf5017 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:35.467612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 371/733] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:35.475052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38460a36-feb6-467b-aa36-9423ebdf5017 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.490743 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38460a36-feb6-467b-aa36-9423ebdf5017 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.491804 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 363/734] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:24:35 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/a34b3d2f67b1477598acce389819c70a/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:24:35.558496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ad0b6-47fe-487f-9985-13438aeff741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.559985 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ad0b6-47fe-487f-9985-13438aeff741 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.560566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ad0b6-47fe-487f-9985-13438aeff741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.561047 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ad0b6-47fe-487f-9985-13438aeff741 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.562118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ad0b6-47fe-487f-9985-13438aeff741 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:35.562695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ad0b6-47fe-487f-9985-13438aeff741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.564672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ad0b6-47fe-487f-9985-13438aeff741 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.574933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 372/735] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:35.581426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e760-b591-455f-9cc6-9822de8e80d0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.593676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e760-b591-455f-9cc6-9822de8e80d0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.599121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cd904-0432-41c8-bb2f-2385635691e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.601050 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cd904-0432-41c8-bb2f-2385635691e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.601599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cd904-0432-41c8-bb2f-2385635691e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.602130 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cd904-0432-41c8-bb2f-2385635691e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.616122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cd904-0432-41c8-bb2f-2385635691e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.618432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cd904-0432-41c8-bb2f-2385635691e8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.638119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-270cd904-0432-41c8-bb2f-2385635691e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:35.640039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 364/736] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:35.646513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ad0b6-47fe-487f-9985-13438aeff741 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.658817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ad0b6-47fe-487f-9985-13438aeff741 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.664000 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f8c9-b57e-413a-8aa2-9c633794a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.664928 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f8c9-b57e-413a-8aa2-9c633794a5ea admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.665408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f8c9-b57e-413a-8aa2-9c633794a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.665925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f8c9-b57e-413a-8aa2-9c633794a5ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.666932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805f8c9-b57e-413a-8aa2-9c633794a5ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:35.667510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805f8c9-b57e-413a-8aa2-9c633794a5ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.669288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805f8c9-b57e-413a-8aa2-9c633794a5ea admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.683623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 373/737] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:35.690114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cd904-0432-41c8-bb2f-2385635691e8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.701519 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cd904-0432-41c8-bb2f-2385635691e8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.706475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c54cf7-694a-4d36-a8e2-cde1ae325a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.707532 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c54cf7-694a-4d36-a8e2-cde1ae325a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.708009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c54cf7-694a-4d36-a8e2-cde1ae325a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.708473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c54cf7-694a-4d36-a8e2-cde1ae325a6c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.717949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c54cf7-694a-4d36-a8e2-cde1ae325a6c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.720567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c54cf7-694a-4d36-a8e2-cde1ae325a6c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.736528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-98c54cf7-694a-4d36-a8e2-cde1ae325a6c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:24:35.738452 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 365/738] 10.222.0.83 () {56 vars in 1138 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:35.744921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f8c9-b57e-413a-8aa2-9c633794a5ea admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.756472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f8c9-b57e-413a-8aa2-9c633794a5ea admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.762251 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216a696-7288-438d-a9cb-05796b54b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.763196 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216a696-7288-438d-a9cb-05796b54b23f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.763731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216a696-7288-438d-a9cb-05796b54b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.764225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216a696-7288-438d-a9cb-05796b54b23f admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.765381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216a696-7288-438d-a9cb-05796b54b23f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:35.766088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216a696-7288-438d-a9cb-05796b54b23f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.768219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216a696-7288-438d-a9cb-05796b54b23f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.788133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 374/739] 10.222.0.83 () {56 vars in 1170 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:35.794483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c54cf7-694a-4d36-a8e2-cde1ae325a6c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.805134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c54cf7-694a-4d36-a8e2-cde1ae325a6c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.810291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51fae3-dab2-4582-8285-36966bb58aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.811204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51fae3-dab2-4582-8285-36966bb58aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.811702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51fae3-dab2-4582-8285-36966bb58aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.812184 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51fae3-dab2-4582-8285-36966bb58aa0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.822027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51fae3-dab2-4582-8285-36966bb58aa0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.824176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51fae3-dab2-4582-8285-36966bb58aa0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.835471 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 366/740] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:24:35.841851 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216a696-7288-438d-a9cb-05796b54b23f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.852491 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216a696-7288-438d-a9cb-05796b54b23f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.862271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3107404-3184-46ca-a75e-2d2defabb35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.863518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3107404-3184-46ca-a75e-2d2defabb35c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.864058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3107404-3184-46ca-a75e-2d2defabb35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.864526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3107404-3184-46ca-a75e-2d2defabb35c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.876616 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3107404-3184-46ca-a75e-2d2defabb35c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.878968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3107404-3184-46ca-a75e-2d2defabb35c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.898972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-e3107404-3184-46ca-a75e-2d2defabb35c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:35.900947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 375/741] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:35.907689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51fae3-dab2-4582-8285-36966bb58aa0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.917727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51fae3-dab2-4582-8285-36966bb58aa0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.923454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ef52-7fda-4153-bdb8-93f334aefd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.924430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ef52-7fda-4153-bdb8-93f334aefd92 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.924928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ef52-7fda-4153-bdb8-93f334aefd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.925406 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ef52-7fda-4153-bdb8-93f334aefd92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.926395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6ef52-7fda-4153-bdb8-93f334aefd92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:35.926920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6ef52-7fda-4153-bdb8-93f334aefd92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.929010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6ef52-7fda-4153-bdb8-93f334aefd92 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.943211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 367/742] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:35.950096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3107404-3184-46ca-a75e-2d2defabb35c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:35.963494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3107404-3184-46ca-a75e-2d2defabb35c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:35.970193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b12a7-1aa0-46d9-a1ab-792859e50ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:35.970995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b12a7-1aa0-46d9-a1ab-792859e50ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:35.971272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b12a7-1aa0-46d9-a1ab-792859e50ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:35.971571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b12a7-1aa0-46d9-a1ab-792859e50ddf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:35.978985 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b12a7-1aa0-46d9-a1ab-792859e50ddf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:35.981005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b12a7-1aa0-46d9-a1ab-792859e50ddf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:35.995050 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-211b12a7-1aa0-46d9-a1ab-792859e50ddf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:35.996564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 376/743] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:36.002864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ef52-7fda-4153-bdb8-93f334aefd92 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:36.014305 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ef52-7fda-4153-bdb8-93f334aefd92 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:36.022618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8799de4-f91a-4976-8363-1ce51e7cc6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:36.023562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799de4-f91a-4976-8363-1ce51e7cc6ea admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:36.024041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799de4-f91a-4976-8363-1ce51e7cc6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:36.024512 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799de4-f91a-4976-8363-1ce51e7cc6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:36.025516 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8799de4-f91a-4976-8363-1ce51e7cc6ea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:36.026095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8799de4-f91a-4976-8363-1ce51e7cc6ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:36.028408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8799de4-f91a-4976-8363-1ce51e7cc6ea admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:36.048642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 368/744] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:36.048825 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b12a7-1aa0-46d9-a1ab-792859e50ddf admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:36.054649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b167ce-460c-44fa-a029-26be74e3762d None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:36.055274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b167ce-460c-44fa-a029-26be74e3762d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:36.055760 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b167ce-460c-44fa-a029-26be74e3762d None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:36.058443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 369/745] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:36.065227 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80f44d-d7ca-4807-b7d1-1aeec94f1792 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:36.065849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80f44d-d7ca-4807-b7d1-1aeec94f1792 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:36.066344 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80f44d-d7ca-4807-b7d1-1aeec94f1792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:36.070650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b12a7-1aa0-46d9-a1ab-792859e50ddf admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:36.075230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89813fb-3624-40e5-a4f1-14992489fda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:36.075877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89813fb-3624-40e5-a4f1-14992489fda6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:36.076158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89813fb-3624-40e5-a4f1-14992489fda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:36.076438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89813fb-3624-40e5-a4f1-14992489fda6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:36.077277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89813fb-3624-40e5-a4f1-14992489fda6 admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=126a2ccd1b86445480efa0468d96960a) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:36.077587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89813fb-3624-40e5-a4f1-14992489fda6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:36.079553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89813fb-3624-40e5-a4f1-14992489fda6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:36.085830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 377/746] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:36 2021] GET /identity/v3/role_assignments?user.id=126a2ccd1b86445480efa0468d96960a&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:36.087255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e74ea-c7bd-4e5d-99cd-3471b5ee1ea0 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:36.087495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-3a80f44d-d7ca-4807-b7d1-1aeec94f1792 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:36.087612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e74ea-c7bd-4e5d-99cd-3471b5ee1ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:36.087805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e74ea-c7bd-4e5d-99cd-3471b5ee1ea0 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:36.088709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3a80f44d-d7ca-4807-b7d1-1aeec94f1792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:36.089459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 378/747] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:36.096111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cc405-fcf5-4772-b421-e7a74daee145 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:36.096552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cc405-fcf5-4772-b421-e7a74daee145 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:36.096937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cc405-fcf5-4772-b421-e7a74daee145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:36.108121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 370/748] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 13:24:36.117782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-619cc405-fcf5-4772-b421-e7a74daee145 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:36.119213 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-619cc405-fcf5-4772-b421-e7a74daee145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:36.128448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 379/749] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 13:24:36.154668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80f44d-d7ca-4807-b7d1-1aeec94f1792 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:36.155871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cc405-fcf5-4772-b421-e7a74daee145 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:36.166015 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80f44d-d7ca-4807-b7d1-1aeec94f1792 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:36.166572 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cc405-fcf5-4772-b421-e7a74daee145 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:36.180232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c5e53-5596-4407-a5aa-27f3a48dc7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:36.180830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5e53-5596-4407-a5aa-27f3a48dc7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:36.181110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5e53-5596-4407-a5aa-27f3a48dc7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:36.181385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5e53-5596-4407-a5aa-27f3a48dc7e2 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:36.182819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c5e53-5596-4407-a5aa-27f3a48dc7e2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:36.183857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ea737-5dfd-4eb7-bf05-74fbc7a829d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:36.184786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea737-5dfd-4eb7-bf05-74fbc7a829d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:36.185060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea737-5dfd-4eb7-bf05-74fbc7a829d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:36.185331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea737-5dfd-4eb7-bf05-74fbc7a829d8 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:36.186156 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ea737-5dfd-4eb7-bf05-74fbc7a829d8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:36.187218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-2f2ea737-5dfd-4eb7-bf05-74fbc7a829d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:36.187218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:24:36.187218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:24:36.188103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ea737-5dfd-4eb7-bf05-74fbc7a829d8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:36.190308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-d88c5e53-5596-4407-a5aa-27f3a48dc7e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:36.190308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:24:36.190308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:24:36.191265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c5e53-5596-4407-a5aa-27f3a48dc7e2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:36.215731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 371/750] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:24:36 2021] POST /identity/v3/services => generated 251 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:36.223588 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 380/751] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:24:36 2021] POST /identity/v3/services => generated 240 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:37.728509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e031450-5bb3-40db-9453-1cbac167632c None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:37.729044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e031450-5bb3-40db-9453-1cbac167632c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:37.729044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e031450-5bb3-40db-9453-1cbac167632c None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:37.731220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 372/752] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:37.737943 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a96d8-5948-4d23-8e9d-d6772472a9a4 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:37.738857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a96d8-5948-4d23-8e9d-d6772472a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:37.739339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a96d8-5948-4d23-8e9d-d6772472a9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:37.767012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-726a96d8-5948-4d23-8e9d-d6772472a9a4 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:37.768579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-726a96d8-5948-4d23-8e9d-d6772472a9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:37.807479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 381/753] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:37 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:37.855279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e031450-5bb3-40db-9453-1cbac167632c None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:37.871310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e031450-5bb3-40db-9453-1cbac167632c None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:37.876227 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd331955-5e76-478f-bcea-295cf5aa63f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:37.877342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd331955-5e76-478f-bcea-295cf5aa63f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:37.877947 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd331955-5e76-478f-bcea-295cf5aa63f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:37.878427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd331955-5e76-478f-bcea-295cf5aa63f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:37.890234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd331955-5e76-478f-bcea-295cf5aa63f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:37.897257 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-fd331955-5e76-478f-bcea-295cf5aa63f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:24:37.899002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 373/754] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:37.905393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a96d8-5948-4d23-8e9d-d6772472a9a4 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:37.915343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a96d8-5948-4d23-8e9d-d6772472a9a4 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:37.925407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65683d02-3ddb-4f3a-875a-85c6048778b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:37.926358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683d02-3ddb-4f3a-875a-85c6048778b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:37.926861 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683d02-3ddb-4f3a-875a-85c6048778b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:37.927334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683d02-3ddb-4f3a-875a-85c6048778b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:37.928293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65683d02-3ddb-4f3a-875a-85c6048778b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:37.929418 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65683d02-3ddb-4f3a-875a-85c6048778b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:37.931273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65683d02-3ddb-4f3a-875a-85c6048778b7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:37.940717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 382/755] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:37.946870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd331955-5e76-478f-bcea-295cf5aa63f2 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:37.957665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd331955-5e76-478f-bcea-295cf5aa63f2 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:37.965847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0ea5e-2a3d-4ff0-bb10-135a9570145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:37.966959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0ea5e-2a3d-4ff0-bb10-135a9570145e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:37.967460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0ea5e-2a3d-4ff0-bb10-135a9570145e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:37.967927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0ea5e-2a3d-4ff0-bb10-135a9570145e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:37.979572 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0ea5e-2a3d-4ff0-bb10-135a9570145e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:37.985828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0ea5e-2a3d-4ff0-bb10-135a9570145e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.005711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-b0e0ea5e-2a3d-4ff0-bb10-135a9570145e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:38.007595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 374/756] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:38.013748 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65683d02-3ddb-4f3a-875a-85c6048778b7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.030931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65683d02-3ddb-4f3a-875a-85c6048778b7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.046965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004c4e2-cf07-4703-89de-7f2c3a868dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.047650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004c4e2-cf07-4703-89de-7f2c3a868dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.047934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004c4e2-cf07-4703-89de-7f2c3a868dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.048217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004c4e2-cf07-4703-89de-7f2c3a868dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.048963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004c4e2-cf07-4703-89de-7f2c3a868dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:38.049270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004c4e2-cf07-4703-89de-7f2c3a868dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.050890 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004c4e2-cf07-4703-89de-7f2c3a868dbe admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.071354 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 383/757] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:38.077113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0ea5e-2a3d-4ff0-bb10-135a9570145e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.091598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0ea5e-2a3d-4ff0-bb10-135a9570145e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.103501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0de452-ed14-44b2-87b6-56352f37f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.104766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0de452-ed14-44b2-87b6-56352f37f65b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.105393 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0de452-ed14-44b2-87b6-56352f37f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.105917 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0de452-ed14-44b2-87b6-56352f37f65b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.120515 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0de452-ed14-44b2-87b6-56352f37f65b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.122971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0de452-ed14-44b2-87b6-56352f37f65b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.138190 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-2d0de452-ed14-44b2-87b6-56352f37f65b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:24:38.140091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 375/758] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/users/swift => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:38.146196 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004c4e2-cf07-4703-89de-7f2c3a868dbe admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.162817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004c4e2-cf07-4703-89de-7f2c3a868dbe admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.178542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5415a8-3e34-4aba-b6dc-0b4105710182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.179736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5415a8-3e34-4aba-b6dc-0b4105710182 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.180021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5415a8-3e34-4aba-b6dc-0b4105710182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.180298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5415a8-3e34-4aba-b6dc-0b4105710182 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.181163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5415a8-3e34-4aba-b6dc-0b4105710182 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:38.181476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5415a8-3e34-4aba-b6dc-0b4105710182 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.183359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5415a8-3e34-4aba-b6dc-0b4105710182 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.209585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 384/759] 10.222.0.83 () {56 vars in 1156 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:38.215543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0de452-ed14-44b2-87b6-56352f37f65b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.235820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0de452-ed14-44b2-87b6-56352f37f65b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.249010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510d10f-61c0-4328-9edf-3ae4e477217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.250748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d10f-61c0-4328-9edf-3ae4e477217c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.251667 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d10f-61c0-4328-9edf-3ae4e477217c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.252213 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d10f-61c0-4328-9edf-3ae4e477217c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.264390 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510d10f-61c0-4328-9edf-3ae4e477217c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.266593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510d10f-61c0-4328-9edf-3ae4e477217c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.277904 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 376/760] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:38.283781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5415a8-3e34-4aba-b6dc-0b4105710182 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.303098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5415a8-3e34-4aba-b6dc-0b4105710182 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.319457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d2240-6b31-4ef5-aa17-c36cb6b65f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.320289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d2240-6b31-4ef5-aa17-c36cb6b65f85 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.320578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d2240-6b31-4ef5-aa17-c36cb6b65f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.320857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d2240-6b31-4ef5-aa17-c36cb6b65f85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.342156 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d2240-6b31-4ef5-aa17-c36cb6b65f85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.344019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d2240-6b31-4ef5-aa17-c36cb6b65f85 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.372262 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-550d2240-6b31-4ef5-aa17-c36cb6b65f85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:38.373466 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 385/761] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:38.379936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510d10f-61c0-4328-9edf-3ae4e477217c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.397781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510d10f-61c0-4328-9edf-3ae4e477217c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.407353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652aa2b-6130-4ef0-9a5a-86c1895f670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.408291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652aa2b-6130-4ef0-9a5a-86c1895f670f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.408772 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652aa2b-6130-4ef0-9a5a-86c1895f670f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.409265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652aa2b-6130-4ef0-9a5a-86c1895f670f admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.410232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652aa2b-6130-4ef0-9a5a-86c1895f670f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:38.410736 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652aa2b-6130-4ef0-9a5a-86c1895f670f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.412509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652aa2b-6130-4ef0-9a5a-86c1895f670f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.432572 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 377/762] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:38.438581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d2240-6b31-4ef5-aa17-c36cb6b65f85 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.454921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d2240-6b31-4ef5-aa17-c36cb6b65f85 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.467757 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061e63-a26d-477f-8d9f-4b585a6fc8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.468565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061e63-a26d-477f-8d9f-4b585a6fc8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.468877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061e63-a26d-477f-8d9f-4b585a6fc8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.469117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061e63-a26d-477f-8d9f-4b585a6fc8b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.486887 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77061e63-a26d-477f-8d9f-4b585a6fc8b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.488831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77061e63-a26d-477f-8d9f-4b585a6fc8b8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.509266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-77061e63-a26d-477f-8d9f-4b585a6fc8b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:38.510788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 386/763] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:38.513419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3da28-cd05-45f1-a60a-4408fa4f19dc None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.514003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3da28-cd05-45f1-a60a-4408fa4f19dc None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.514481 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3da28-cd05-45f1-a60a-4408fa4f19dc None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.516864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061e63-a26d-477f-8d9f-4b585a6fc8b8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.518662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 378/764] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:38.522201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c71c54-0c57-477f-ab92-82fb47bd59d5 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.523002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c71c54-0c57-477f-ab92-82fb47bd59d5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.523281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c71c54-0c57-477f-ab92-82fb47bd59d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.533140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061e63-a26d-477f-8d9f-4b585a6fc8b8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.545041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897434f9-5026-417c-bb5c-78735f1d43d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.545702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897434f9-5026-417c-bb5c-78735f1d43d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.546008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897434f9-5026-417c-bb5c-78735f1d43d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.546284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897434f9-5026-417c-bb5c-78735f1d43d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.547085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897434f9-5026-417c-bb5c-78735f1d43d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:38.547392 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897434f9-5026-417c-bb5c-78735f1d43d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.550417 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897434f9-5026-417c-bb5c-78735f1d43d8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.557062 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-96c71c54-0c57-477f-ab92-82fb47bd59d5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:38.558289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-96c71c54-0c57-477f-ab92-82fb47bd59d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:38.575566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 387/765] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:38.576173 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 379/766] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:38 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:38.582993 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897434f9-5026-417c-bb5c-78735f1d43d8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.595182 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897434f9-5026-417c-bb5c-78735f1d43d8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.602858 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471b39e-2805-428c-950c-18347f451154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.603645 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471b39e-2805-428c-950c-18347f451154 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.603929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471b39e-2805-428c-950c-18347f451154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.604206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471b39e-2805-428c-950c-18347f451154 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.605103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471b39e-2805-428c-950c-18347f451154 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=93ec8ea8a0904d30b6a95c8ebc9dd634) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:38.605449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471b39e-2805-428c-950c-18347f451154 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.607538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471b39e-2805-428c-950c-18347f451154 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.618928 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 388/767] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/role_assignments?user.id=93ec8ea8a0904d30b6a95c8ebc9dd634&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=a312b345efeb490eb4234d1ace386dec => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:38.636214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c71c54-0c57-477f-ab92-82fb47bd59d5 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.649746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c71c54-0c57-477f-ab92-82fb47bd59d5 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.664324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dac87-517a-40ad-9c8d-610035f855f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.665150 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dac87-517a-40ad-9c8d-610035f855f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.665486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dac87-517a-40ad-9c8d-610035f855f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.665783 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dac87-517a-40ad-9c8d-610035f855f5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.683252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dac87-517a-40ad-9c8d-610035f855f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:38.690481 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-879dac87-517a-40ad-9c8d-610035f855f5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:24:38.691702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 380/768] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:38.699489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471b39e-2805-428c-950c-18347f451154 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.720527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471b39e-2805-428c-950c-18347f451154 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.735840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f70e71-0602-43a3-a810-1a24a6f2668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.736541 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f70e71-0602-43a3-a810-1a24a6f2668a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.736815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f70e71-0602-43a3-a810-1a24a6f2668a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.737132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f70e71-0602-43a3-a810-1a24a6f2668a admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.737995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f70e71-0602-43a3-a810-1a24a6f2668a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:38.738623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f70e71-0602-43a3-a810-1a24a6f2668a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.739906 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f70e71-0602-43a3-a810-1a24a6f2668a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.760580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 389/769] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:38.769712 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dac87-517a-40ad-9c8d-610035f855f5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.797715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dac87-517a-40ad-9c8d-610035f855f5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.807758 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e60df-323b-4911-8278-5b60d0960e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.809296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e60df-323b-4911-8278-5b60d0960e6c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.810078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e60df-323b-4911-8278-5b60d0960e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.810556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e60df-323b-4911-8278-5b60d0960e6c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.831392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e60df-323b-4911-8278-5b60d0960e6c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.833323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e60df-323b-4911-8278-5b60d0960e6c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.851945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-bf2e60df-323b-4911-8278-5b60d0960e6c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:38.853593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 381/770] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:38.859921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f70e71-0602-43a3-a810-1a24a6f2668a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.879017 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f70e71-0602-43a3-a810-1a24a6f2668a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.891748 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca2038-eb6a-4c72-8444-cbddc3418551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.892443 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca2038-eb6a-4c72-8444-cbddc3418551 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.892723 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca2038-eb6a-4c72-8444-cbddc3418551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.892999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca2038-eb6a-4c72-8444-cbddc3418551 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.893750 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca2038-eb6a-4c72-8444-cbddc3418551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:38.894095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca2038-eb6a-4c72-8444-cbddc3418551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.895741 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca2038-eb6a-4c72-8444-cbddc3418551 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.920683 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 390/771] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:38.926641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e60df-323b-4911-8278-5b60d0960e6c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:38.942889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e60df-323b-4911-8278-5b60d0960e6c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:38.952539 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f6fb1-34c6-4599-a7aa-b77e7d80086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:38.953688 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6fb1-34c6-4599-a7aa-b77e7d80086b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:38.954170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6fb1-34c6-4599-a7aa-b77e7d80086b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:38.954659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6fb1-34c6-4599-a7aa-b77e7d80086b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:38.965918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f6fb1-34c6-4599-a7aa-b77e7d80086b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:38.968195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f6fb1-34c6-4599-a7aa-b77e7d80086b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:38.989145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-291f6fb1-34c6-4599-a7aa-b77e7d80086b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:24:38.991904 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 382/772] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:38.998528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca2038-eb6a-4c72-8444-cbddc3418551 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.024549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca2038-eb6a-4c72-8444-cbddc3418551 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.035379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43361d60-d4b1-484e-a841-bba28c86b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.036056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361d60-d4b1-484e-a841-bba28c86b568 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.036331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361d60-d4b1-484e-a841-bba28c86b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.036600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361d60-d4b1-484e-a841-bba28c86b568 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.037458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43361d60-d4b1-484e-a841-bba28c86b568 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.037777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43361d60-d4b1-484e-a841-bba28c86b568 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.039642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43361d60-d4b1-484e-a841-bba28c86b568 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.060917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 391/773] 10.222.0.83 () {56 vars in 1154 bytes} [Wed Dec 15 13:24:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.067251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f6fb1-34c6-4599-a7aa-b77e7d80086b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.070561 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ccf2-7422-4ab3-bab6-2b9da10e27c5 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.070848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ccf2-7422-4ab3-bab6-2b9da10e27c5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.071122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ccf2-7422-4ab3-bab6-2b9da10e27c5 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.072980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 392/774] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:39.080838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f6fb1-34c6-4599-a7aa-b77e7d80086b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.082822 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d6c34-71b2-4d71-88a5-acd00a59b6df None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.083103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d6c34-71b2-4d71-88a5-acd00a59b6df None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.083374 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d6c34-71b2-4d71-88a5-acd00a59b6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.097978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7107910-20af-43b5-88c1-9b713b237f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.098634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7107910-20af-43b5-88c1-9b713b237f10 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.098910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7107910-20af-43b5-88c1-9b713b237f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.099179 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7107910-20af-43b5-88c1-9b713b237f10 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.111694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-259d6c34-71b2-4d71-88a5-acd00a59b6df None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:39.112883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-259d6c34-71b2-4d71-88a5-acd00a59b6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:39.114743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7107910-20af-43b5-88c1-9b713b237f10 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.117016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7107910-20af-43b5-88c1-9b713b237f10 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.131149 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 383/775] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:39.138728 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7107910-20af-43b5-88c1-9b713b237f10 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.142668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 393/776] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:39 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:39.150586 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7107910-20af-43b5-88c1-9b713b237f10 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.159704 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d648a-514f-4d69-9c4e-cf7f49e6ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.160558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d648a-514f-4d69-9c4e-cf7f49e6ca36 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.160833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d648a-514f-4d69-9c4e-cf7f49e6ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.161100 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d648a-514f-4d69-9c4e-cf7f49e6ca36 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.177382 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d648a-514f-4d69-9c4e-cf7f49e6ca36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.179754 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d648a-514f-4d69-9c4e-cf7f49e6ca36 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.193872 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d6c34-71b2-4d71-88a5-acd00a59b6df None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.209157 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d6c34-71b2-4d71-88a5-acd00a59b6df None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.213372 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-826d648a-514f-4d69-9c4e-cf7f49e6ca36 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:39.214949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 384/777] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:39.216118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa072e98-a5b1-468b-8ff7-2f4f9c02d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.216913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072e98-a5b1-468b-8ff7-2f4f9c02d037 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.217189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072e98-a5b1-468b-8ff7-2f4f9c02d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.217459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072e98-a5b1-468b-8ff7-2f4f9c02d037 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.227623 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d648a-514f-4d69-9c4e-cf7f49e6ca36 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.231880 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa072e98-a5b1-468b-8ff7-2f4f9c02d037 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:39.239303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-aa072e98-a5b1-468b-8ff7-2f4f9c02d037 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:39.241554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 394/778] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:39.249592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d648a-514f-4d69-9c4e-cf7f49e6ca36 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.250871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa072e98-a5b1-468b-8ff7-2f4f9c02d037 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.262236 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa072e98-a5b1-468b-8ff7-2f4f9c02d037 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.262474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3499f92-4879-4caa-9210-8a1c2b90816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.263160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499f92-4879-4caa-9210-8a1c2b90816a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.263433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499f92-4879-4caa-9210-8a1c2b90816a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.263705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499f92-4879-4caa-9210-8a1c2b90816a admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.264564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3499f92-4879-4caa-9210-8a1c2b90816a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.264864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3499f92-4879-4caa-9210-8a1c2b90816a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.266753 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3499f92-4879-4caa-9210-8a1c2b90816a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.268195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e38975-60f4-460e-940b-fe02e6f857f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.269045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38975-60f4-460e-940b-fe02e6f857f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.269480 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38975-60f4-460e-940b-fe02e6f857f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.269973 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38975-60f4-460e-940b-fe02e6f857f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.270875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e38975-60f4-460e-940b-fe02e6f857f5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.271376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e38975-60f4-460e-940b-fe02e6f857f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.273228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e38975-60f4-460e-940b-fe02e6f857f5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.283246 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 395/779] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.292206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 385/780] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.293587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e38975-60f4-460e-940b-fe02e6f857f5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.298176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3499f92-4879-4caa-9210-8a1c2b90816a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.304307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e38975-60f4-460e-940b-fe02e6f857f5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.311657 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3499f92-4879-4caa-9210-8a1c2b90816a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.315233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba076361-ef94-4abf-a0d8-3344150f3729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.316203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba076361-ef94-4abf-a0d8-3344150f3729 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.316649 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba076361-ef94-4abf-a0d8-3344150f3729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.317059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba076361-ef94-4abf-a0d8-3344150f3729 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.329056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656abf50-eaa3-4053-8374-0c3ff226384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.330104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656abf50-eaa3-4053-8374-0c3ff226384e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.330543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656abf50-eaa3-4053-8374-0c3ff226384e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.330965 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656abf50-eaa3-4053-8374-0c3ff226384e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.339243 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba076361-ef94-4abf-a0d8-3344150f3729 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.341307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba076361-ef94-4abf-a0d8-3344150f3729 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.342313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656abf50-eaa3-4053-8374-0c3ff226384e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.344447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656abf50-eaa3-4053-8374-0c3ff226384e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.358509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-656abf50-eaa3-4053-8374-0c3ff226384e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:39.360435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-ba076361-ef94-4abf-a0d8-3344150f3729 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:39.360598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 386/781] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:39.361982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 396/782] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:39.362099 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180db67-524a-47af-8f8a-ad6302279a70 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.362513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180db67-524a-47af-8f8a-ad6302279a70 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.362927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180db67-524a-47af-8f8a-ad6302279a70 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.363621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5930c4-a29d-46dd-acab-827a33d76ecd None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.364004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5930c4-a29d-46dd-acab-827a33d76ecd None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.364376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5930c4-a29d-46dd-acab-827a33d76ecd None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.365504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 387/783] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:39.366927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180db67-524a-47af-8f8a-ad6302279a70 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.370855 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 397/784] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:39 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:39.370855 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5930c4-a29d-46dd-acab-827a33d76ecd None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.383509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180db67-524a-47af-8f8a-ad6302279a70 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.383749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5930c4-a29d-46dd-acab-827a33d76ecd None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.388122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2590e-1b21-4ea5-9b1f-077e062d9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.388263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30657748-51ab-4b1a-b463-f17cce3f5478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.388759 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657748-51ab-4b1a-b463-f17cce3f5478 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.389032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657748-51ab-4b1a-b463-f17cce3f5478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.389138 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2590e-1b21-4ea5-9b1f-077e062d9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.389305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657748-51ab-4b1a-b463-f17cce3f5478 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.389582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2590e-1b21-4ea5-9b1f-077e062d9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.389979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2590e-1b21-4ea5-9b1f-077e062d9b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.390069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30657748-51ab-4b1a-b463-f17cce3f5478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.390350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30657748-51ab-4b1a-b463-f17cce3f5478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.391035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2590e-1b21-4ea5-9b1f-077e062d9b46 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.391438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2590e-1b21-4ea5-9b1f-077e062d9b46 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.391919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30657748-51ab-4b1a-b463-f17cce3f5478 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.393415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2590e-1b21-4ea5-9b1f-077e062d9b46 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.403268 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 398/785] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.409884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 388/786] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.409884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fe4d2-f12f-478e-81a0-64d522c7ce89 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.409884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fe4d2-f12f-478e-81a0-64d522c7ce89 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.409884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fe4d2-f12f-478e-81a0-64d522c7ce89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.410201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650046-22a8-45b2-99b6-141612f02265 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.410201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650046-22a8-45b2-99b6-141612f02265 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.410201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650046-22a8-45b2-99b6-141612f02265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.426549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-719fe4d2-f12f-478e-81a0-64d522c7ce89 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:39.427719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-719fe4d2-f12f-478e-81a0-64d522c7ce89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:39.427898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8a650046-22a8-45b2-99b6-141612f02265 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:39.429600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8a650046-22a8-45b2-99b6-141612f02265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:39.437786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 389/787] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:39 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:39.437786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fe4d2-f12f-478e-81a0-64d522c7ce89 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.439425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 399/788] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:39 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:39.440357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a650046-22a8-45b2-99b6-141612f02265 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.450277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a650046-22a8-45b2-99b6-141612f02265 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.455967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5add8-7734-453e-b6dd-1f30fe54c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.456976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5add8-7734-453e-b6dd-1f30fe54c398 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.457442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5add8-7734-453e-b6dd-1f30fe54c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.457901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5add8-7734-453e-b6dd-1f30fe54c398 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.460252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fe4d2-f12f-478e-81a0-64d522c7ce89 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.466089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944480d3-8024-4339-ba80-12d3d9f45872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.466861 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944480d3-8024-4339-ba80-12d3d9f45872 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.467029 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5add8-7734-453e-b6dd-1f30fe54c398 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.467334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944480d3-8024-4339-ba80-12d3d9f45872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.467710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944480d3-8024-4339-ba80-12d3d9f45872 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.468661 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944480d3-8024-4339-ba80-12d3d9f45872 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=a34b3d2f67b1477598acce389819c70a) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.469094 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944480d3-8024-4339-ba80-12d3d9f45872 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.469643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5add8-7734-453e-b6dd-1f30fe54c398 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.471121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944480d3-8024-4339-ba80-12d3d9f45872 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.478378 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 390/789] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/role_assignments?user.id=a34b3d2f67b1477598acce389819c70a&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=a312b345efeb490eb4234d1ace386dec => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.482706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944480d3-8024-4339-ba80-12d3d9f45872 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.489075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-9cf5add8-7734-453e-b6dd-1f30fe54c398 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:24:39.494264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 400/790] 10.222.0.83 () {56 vars in 1138 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:39.494649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944480d3-8024-4339-ba80-12d3d9f45872 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.495208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5add8-7734-453e-b6dd-1f30fe54c398 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.505019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8a363-0211-4196-9c35-a80408453d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.505619 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8a363-0211-4196-9c35-a80408453d2d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.505931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8a363-0211-4196-9c35-a80408453d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.506200 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8a363-0211-4196-9c35-a80408453d2d admin admin] PATH_INFO: `/v3/services/network` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.506906 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8a363-0211-4196-9c35-a80408453d2d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.508529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8a363-0211-4196-9c35-a80408453d2d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.510219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5add8-7734-453e-b6dd-1f30fe54c398 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.516060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc66fe8-f76b-4e49-bb8c-89b87ca01fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.517293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66fe8-f76b-4e49-bb8c-89b87ca01fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.517715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66fe8-f76b-4e49-bb8c-89b87ca01fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.518203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66fe8-f76b-4e49-bb8c-89b87ca01fc5 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.520477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc66fe8-f76b-4e49-bb8c-89b87ca01fc5 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.520777 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-06f8a363-0211-4196-9c35-a80408453d2d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 13:24:39.522459 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 391/791] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/services/network => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:39.522751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc66fe8-f76b-4e49-bb8c-89b87ca01fc5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.523369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8a363-0211-4196-9c35-a80408453d2d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.533488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8a363-0211-4196-9c35-a80408453d2d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.536657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-adc66fe8-f76b-4e49-bb8c-89b87ca01fc5 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 13:24:39.543797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9e7cc-1afb-4368-9dd5-3555bf7a25f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.543797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9e7cc-1afb-4368-9dd5-3555bf7a25f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.543797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9e7cc-1afb-4368-9dd5-3555bf7a25f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.543797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9e7cc-1afb-4368-9dd5-3555bf7a25f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.544236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9e7cc-1afb-4368-9dd5-3555bf7a25f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.544236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9e7cc-1afb-4368-9dd5-3555bf7a25f3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.544236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9e7cc-1afb-4368-9dd5-3555bf7a25f3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.544792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 401/792] 10.222.0.83 () {56 vars in 1150 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:39.546166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc66fe8-f76b-4e49-bb8c-89b87ca01fc5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.560463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc66fe8-f76b-4e49-bb8c-89b87ca01fc5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.569899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 392/793] 10.222.0.83 () {56 vars in 1170 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.571229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9e7cc-1afb-4368-9dd5-3555bf7a25f3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.572382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e730368-59a9-4fd6-af6b-c2f41bfc2b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.573061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e730368-59a9-4fd6-af6b-c2f41bfc2b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.573337 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e730368-59a9-4fd6-af6b-c2f41bfc2b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.573605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e730368-59a9-4fd6-af6b-c2f41bfc2b1b admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.574374 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e730368-59a9-4fd6-af6b-c2f41bfc2b1b admin admin] RBAC: Adding query filter params (name=network) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.574678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e730368-59a9-4fd6-af6b-c2f41bfc2b1b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.576298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e730368-59a9-4fd6-af6b-c2f41bfc2b1b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.582860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 402/794] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/services?name=network => generated 124 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.583710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e730368-59a9-4fd6-af6b-c2f41bfc2b1b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.585203 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9e7cc-1afb-4368-9dd5-3555bf7a25f3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.590255 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf55bb7-6de9-4b1e-9835-04614704f818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.591184 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf55bb7-6de9-4b1e-9835-04614704f818 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.591745 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf55bb7-6de9-4b1e-9835-04614704f818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.592194 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf55bb7-6de9-4b1e-9835-04614704f818 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.593156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf55bb7-6de9-4b1e-9835-04614704f818 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.593676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e730368-59a9-4fd6-af6b-c2f41bfc2b1b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.593842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf55bb7-6de9-4b1e-9835-04614704f818 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.596262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf55bb7-6de9-4b1e-9835-04614704f818 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.598624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549464f-f437-4c88-8d81-41d17b0c10ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.599780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549464f-f437-4c88-8d81-41d17b0c10ae admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.600062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549464f-f437-4c88-8d81-41d17b0c10ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.600888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549464f-f437-4c88-8d81-41d17b0c10ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.603868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 393/795] 10.222.0.83 () {56 vars in 1145 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.605036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf55bb7-6de9-4b1e-9835-04614704f818 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.615628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf55bb7-6de9-4b1e-9835-04614704f818 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.619961 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549464f-f437-4c88-8d81-41d17b0c10ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.621481 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af030dd6-a5f8-4ba0-b3f0-331ba5248504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.621821 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549464f-f437-4c88-8d81-41d17b0c10ae admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.622788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af030dd6-a5f8-4ba0-b3f0-331ba5248504 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.623296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af030dd6-a5f8-4ba0-b3f0-331ba5248504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.623801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af030dd6-a5f8-4ba0-b3f0-331ba5248504 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.624715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af030dd6-a5f8-4ba0-b3f0-331ba5248504 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.625254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af030dd6-a5f8-4ba0-b3f0-331ba5248504 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.627156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af030dd6-a5f8-4ba0-b3f0-331ba5248504 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.634390 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 394/796] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.635511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af030dd6-a5f8-4ba0-b3f0-331ba5248504 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.640189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-9549464f-f437-4c88-8d81-41d17b0c10ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:39.641633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 403/797] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:39.642450 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549464f-f437-4c88-8d81-41d17b0c10ae admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.647192 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af030dd6-a5f8-4ba0-b3f0-331ba5248504 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.652270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec96c6e-19b1-4292-93f6-210453d207af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.653291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec96c6e-19b1-4292-93f6-210453d207af admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.653419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549464f-f437-4c88-8d81-41d17b0c10ae admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.653842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec96c6e-19b1-4292-93f6-210453d207af admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.654383 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec96c6e-19b1-4292-93f6-210453d207af admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.655859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec96c6e-19b1-4292-93f6-210453d207af admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.656393 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec96c6e-19b1-4292-93f6-210453d207af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.658141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbbf33-d24f-49a1-9c0b-45848d70a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.658733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbbf33-d24f-49a1-9c0b-45848d70a9bc admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.659013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbbf33-d24f-49a1-9c0b-45848d70a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.659287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbbf33-d24f-49a1-9c0b-45848d70a9bc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.660095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbbf33-d24f-49a1-9c0b-45848d70a9bc admin admin] RBAC: Adding query filter params (interface=public, service_id=2672f457099a441cbbf16d9136ab5993, region_id=RegionOne) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.660219 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec96c6e-19b1-4292-93f6-210453d207af admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.660400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbbf33-d24f-49a1-9c0b-45848d70a9bc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.661489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-b4fbbf33-d24f-49a1-9c0b-45848d70a9bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:39.661489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:24:39.661489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:24:39.662648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbbf33-d24f-49a1-9c0b-45848d70a9bc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.667572 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 395/798] 10.222.0.83 () {56 vars in 1145 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.668699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec96c6e-19b1-4292-93f6-210453d207af admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.679866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec96c6e-19b1-4292-93f6-210453d207af admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.684634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcea492-ffe4-4fa7-a101-079c7f5f969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.685319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcea492-ffe4-4fa7-a101-079c7f5f969f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.685596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcea492-ffe4-4fa7-a101-079c7f5f969f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.685932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcea492-ffe4-4fa7-a101-079c7f5f969f admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.686682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcea492-ffe4-4fa7-a101-079c7f5f969f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.686981 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcea492-ffe4-4fa7-a101-079c7f5f969f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.688578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcea492-ffe4-4fa7-a101-079c7f5f969f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.691591 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 404/799] 10.222.0.83 () {56 vars in 1272 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/endpoints?service_id=2672f457099a441cbbf16d9136ab5993&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.692461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbbf33-d24f-49a1-9c0b-45848d70a9bc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.701243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 396/800] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.705902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcea492-ffe4-4fa7-a101-079c7f5f969f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.716917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbbf33-d24f-49a1-9c0b-45848d70a9bc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.717926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcea492-ffe4-4fa7-a101-079c7f5f969f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.721951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e195cb-fdcb-46df-808c-5d9c47d66198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.722675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e195cb-fdcb-46df-808c-5d9c47d66198 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.723004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e195cb-fdcb-46df-808c-5d9c47d66198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.723285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e195cb-fdcb-46df-808c-5d9c47d66198 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.724162 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e195cb-fdcb-46df-808c-5d9c47d66198 admin admin] RBAC: Adding query filter params (interface=public, service_id=37771313512144759b64cb181e9ba06e, region_id=RegionOne) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.724478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e195cb-fdcb-46df-808c-5d9c47d66198 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.724715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e5499-935e-4d5a-931d-107d0c793589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.726183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5499-935e-4d5a-931d-107d0c793589 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.726646 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5499-935e-4d5a-931d-107d0c793589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.726807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e195cb-fdcb-46df-808c-5d9c47d66198 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.727252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5499-935e-4d5a-931d-107d0c793589 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.728180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e5499-935e-4d5a-931d-107d0c793589 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.730956 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e5499-935e-4d5a-931d-107d0c793589 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.733216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 405/801] 10.222.0.83 () {56 vars in 1272 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/endpoints?service_id=37771313512144759b64cb181e9ba06e&interface=public®ion_id=RegionOne => generated 194 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.734194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e195cb-fdcb-46df-808c-5d9c47d66198 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.737876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 397/802] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/services => generated 772 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.739343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e5499-935e-4d5a-931d-107d0c793589 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.744991 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e195cb-fdcb-46df-808c-5d9c47d66198 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.750729 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8110ed-d2a2-4429-923e-9a511b24b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.751784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8110ed-d2a2-4429-923e-9a511b24b1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.752454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e5499-935e-4d5a-931d-107d0c793589 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.753368 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8110ed-d2a2-4429-923e-9a511b24b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.753811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8110ed-d2a2-4429-923e-9a511b24b1fa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.758676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b345-ddc2-4a17-8233-fa2513f21694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.759630 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b345-ddc2-4a17-8233-fa2513f21694 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.760084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b345-ddc2-4a17-8233-fa2513f21694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.760536 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b345-ddc2-4a17-8233-fa2513f21694 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.761441 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b345-ddc2-4a17-8233-fa2513f21694 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.763791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b345-ddc2-4a17-8233-fa2513f21694 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.765252 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8110ed-d2a2-4429-923e-9a511b24b1fa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.767477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8110ed-d2a2-4429-923e-9a511b24b1fa admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.771321 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 398/803] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/services => generated 772 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:39.786228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-1e8110ed-d2a2-4429-923e-9a511b24b1fa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:39.787709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 406/804] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:39.794847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b345-ddc2-4a17-8233-fa2513f21694 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.806291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b345-ddc2-4a17-8233-fa2513f21694 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.811806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d0981-c856-4ca9-adb5-175fbde60950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.812515 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d0981-c856-4ca9-adb5-175fbde60950 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.812838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d0981-c856-4ca9-adb5-175fbde60950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.813141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d0981-c856-4ca9-adb5-175fbde60950 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.814126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d0981-c856-4ca9-adb5-175fbde60950 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:39.814472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d0981-c856-4ca9-adb5-175fbde60950 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.816597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d0981-c856-4ca9-adb5-175fbde60950 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.831967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 399/805] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:39.839052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8110ed-d2a2-4429-923e-9a511b24b1fa admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:39.851498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8110ed-d2a2-4429-923e-9a511b24b1fa admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:39.856820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c40cb-7b85-45c2-8e96-1a4dce026728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:39.858272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c40cb-7b85-45c2-8e96-1a4dce026728 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:39.858820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c40cb-7b85-45c2-8e96-1a4dce026728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:39.859324 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c40cb-7b85-45c2-8e96-1a4dce026728 admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/126a2ccd1b86445480efa0468d96960a/roles/35803c6179744bf1933e2b30b362f87d` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:39.878025 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c40cb-7b85-45c2-8e96-1a4dce026728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=126a2ccd1b86445480efa0468d96960a, role_id=35803c6179744bf1933e2b30b362f87d)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:39.881358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c40cb-7b85-45c2-8e96-1a4dce026728 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:39.900753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 407/806] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:24:39 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/126a2ccd1b86445480efa0468d96960a/roles/35803c6179744bf1933e2b30b362f87d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:41.671587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e71bb-0ebd-47b6-a9db-1c88baff3efc None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:41.672531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e71bb-0ebd-47b6-a9db-1c88baff3efc None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:41.673042 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e71bb-0ebd-47b6-a9db-1c88baff3efc None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:41.675025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 400/807] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:41.681661 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0faf31-53c1-44a5-b493-4e32bf81deea None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:41.682083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0faf31-53c1-44a5-b493-4e32bf81deea None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:41.682283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0faf31-53c1-44a5-b493-4e32bf81deea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:41.706659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2f0faf31-53c1-44a5-b493-4e32bf81deea None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:41.707867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2f0faf31-53c1-44a5-b493-4e32bf81deea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:41.781990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 408/808] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:41 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:41.821769 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e71bb-0ebd-47b6-a9db-1c88baff3efc None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:41.838419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e71bb-0ebd-47b6-a9db-1c88baff3efc None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:41.845558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6229f6-5465-4e1f-9165-1cf906f52bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:41.846368 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6229f6-5465-4e1f-9165-1cf906f52bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:41.846645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6229f6-5465-4e1f-9165-1cf906f52bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:41.846913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6229f6-5465-4e1f-9165-1cf906f52bd6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:41.867287 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6229f6-5465-4e1f-9165-1cf906f52bd6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:41.874031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-ba6229f6-5465-4e1f-9165-1cf906f52bd6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:24:41.875713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 401/809] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:41.881688 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0faf31-53c1-44a5-b493-4e32bf81deea None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:41.896200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0faf31-53c1-44a5-b493-4e32bf81deea None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:41.904426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f65dd-7246-4ce0-ab73-566c0ae2d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:41.905150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f65dd-7246-4ce0-ab73-566c0ae2d65d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:41.905382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f65dd-7246-4ce0-ab73-566c0ae2d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:41.905657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f65dd-7246-4ce0-ab73-566c0ae2d65d admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:41.906536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f65dd-7246-4ce0-ab73-566c0ae2d65d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:41.906844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f65dd-7246-4ce0-ab73-566c0ae2d65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:41.908431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f65dd-7246-4ce0-ab73-566c0ae2d65d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:41.921457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 409/810] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:41.927537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6229f6-5465-4e1f-9165-1cf906f52bd6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:41.942865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6229f6-5465-4e1f-9165-1cf906f52bd6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:41.950059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f648302-a3f9-48a2-b186-69ac6e446dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:41.950861 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648302-a3f9-48a2-b186-69ac6e446dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:41.951143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648302-a3f9-48a2-b186-69ac6e446dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:41.951420 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648302-a3f9-48a2-b186-69ac6e446dc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:41.965392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f648302-a3f9-48a2-b186-69ac6e446dc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:41.967264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f648302-a3f9-48a2-b186-69ac6e446dc8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:41.993992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-3f648302-a3f9-48a2-b186-69ac6e446dc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:41.995525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 402/811] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:42.001396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f65dd-7246-4ce0-ab73-566c0ae2d65d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.020842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f65dd-7246-4ce0-ab73-566c0ae2d65d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.034406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470c51-7c7e-430f-a01c-a607f189022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.035087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470c51-7c7e-430f-a01c-a607f189022a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.035374 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470c51-7c7e-430f-a01c-a607f189022a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.035655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470c51-7c7e-430f-a01c-a607f189022a admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.036400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41470c51-7c7e-430f-a01c-a607f189022a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:42.036711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41470c51-7c7e-430f-a01c-a607f189022a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.038870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41470c51-7c7e-430f-a01c-a607f189022a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.053026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 410/812] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:42.058997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f648302-a3f9-48a2-b186-69ac6e446dc8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.069194 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f648302-a3f9-48a2-b186-69ac6e446dc8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.081505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1db9b-0540-4eed-9d93-d0d8d1175e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.082340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1db9b-0540-4eed-9d93-d0d8d1175e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.082621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1db9b-0540-4eed-9d93-d0d8d1175e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.082893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1db9b-0540-4eed-9d93-d0d8d1175e5a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.094616 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1db9b-0540-4eed-9d93-d0d8d1175e5a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.096613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1db9b-0540-4eed-9d93-d0d8d1175e5a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.115192 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-c3f1db9b-0540-4eed-9d93-d0d8d1175e5a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:24:42.116732 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 403/813] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:42.122693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470c51-7c7e-430f-a01c-a607f189022a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.139044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470c51-7c7e-430f-a01c-a607f189022a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.147237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c136cc-01df-49d9-9cbb-8cb4750777ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.148519 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c136cc-01df-49d9-9cbb-8cb4750777ed admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.148803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c136cc-01df-49d9-9cbb-8cb4750777ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.149114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c136cc-01df-49d9-9cbb-8cb4750777ed admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.150072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c136cc-01df-49d9-9cbb-8cb4750777ed admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:42.150385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c136cc-01df-49d9-9cbb-8cb4750777ed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.152345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c136cc-01df-49d9-9cbb-8cb4750777ed admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.186003 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 411/814] 10.222.0.83 () {56 vars in 1156 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:42.192432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1db9b-0540-4eed-9d93-d0d8d1175e5a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.211820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1db9b-0540-4eed-9d93-d0d8d1175e5a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.220554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f757bb-7ed1-41d7-9a03-8bd237c54773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.220554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f757bb-7ed1-41d7-9a03-8bd237c54773 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.220554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f757bb-7ed1-41d7-9a03-8bd237c54773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.220554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f757bb-7ed1-41d7-9a03-8bd237c54773 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.238881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f757bb-7ed1-41d7-9a03-8bd237c54773 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.241041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f757bb-7ed1-41d7-9a03-8bd237c54773 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.266630 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-26f757bb-7ed1-41d7-9a03-8bd237c54773 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:42.268189 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 404/815] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:42.274678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c136cc-01df-49d9-9cbb-8cb4750777ed admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.292823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c136cc-01df-49d9-9cbb-8cb4750777ed admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.300276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9ef79-1072-49d6-bee6-d61590978e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.301050 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9ef79-1072-49d6-bee6-d61590978e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.301449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9ef79-1072-49d6-bee6-d61590978e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.301839 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9ef79-1072-49d6-bee6-d61590978e8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.303330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9ef79-1072-49d6-bee6-d61590978e8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:42.303931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9ef79-1072-49d6-bee6-d61590978e8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.306685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9ef79-1072-49d6-bee6-d61590978e8b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.330401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 412/816] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:42.337214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f757bb-7ed1-41d7-9a03-8bd237c54773 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.351928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f757bb-7ed1-41d7-9a03-8bd237c54773 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.362167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feb071-906f-4627-8ab6-5e37dcb32580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.362966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb071-906f-4627-8ab6-5e37dcb32580 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.363241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb071-906f-4627-8ab6-5e37dcb32580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.363507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb071-906f-4627-8ab6-5e37dcb32580 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.375527 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14feb071-906f-4627-8ab6-5e37dcb32580 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.377478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14feb071-906f-4627-8ab6-5e37dcb32580 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.395871 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-14feb071-906f-4627-8ab6-5e37dcb32580 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:42.397297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 405/817] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:42.404071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9ef79-1072-49d6-bee6-d61590978e8b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.417882 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9ef79-1072-49d6-bee6-d61590978e8b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.426045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d8237-93f1-45da-a850-1f0d7dd227d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.426839 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d8237-93f1-45da-a850-1f0d7dd227d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.427192 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d8237-93f1-45da-a850-1f0d7dd227d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.427537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d8237-93f1-45da-a850-1f0d7dd227d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.428471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d8237-93f1-45da-a850-1f0d7dd227d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:42.428878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d8237-93f1-45da-a850-1f0d7dd227d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.431053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d8237-93f1-45da-a850-1f0d7dd227d6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.451219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 413/818] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:42.457655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feb071-906f-4627-8ab6-5e37dcb32580 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.468006 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feb071-906f-4627-8ab6-5e37dcb32580 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.477812 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9006f9-fee3-4a0f-9ccd-c8e45185eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.478931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9006f9-fee3-4a0f-9ccd-c8e45185eb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.479350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9006f9-fee3-4a0f-9ccd-c8e45185eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.479771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9006f9-fee3-4a0f-9ccd-c8e45185eb1a admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/93ec8ea8a0904d30b6a95c8ebc9dd634/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.486558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9006f9-fee3-4a0f-9ccd-c8e45185eb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=93ec8ea8a0904d30b6a95c8ebc9dd634, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.489370 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9006f9-fee3-4a0f-9ccd-c8e45185eb1a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.504684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 406/819] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:24:42 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/93ec8ea8a0904d30b6a95c8ebc9dd634/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:24:42.655186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bb45-d459-4e9c-b66e-68110a30ea7f None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.655281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bb45-d459-4e9c-b66e-68110a30ea7f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.655571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bb45-d459-4e9c-b66e-68110a30ea7f None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.657624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 414/820] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:42.675984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc364bd3-8b57-4cc4-9ccd-683548713108 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.676499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc364bd3-8b57-4cc4-9ccd-683548713108 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.676499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc364bd3-8b57-4cc4-9ccd-683548713108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.686236 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab391fcb-a5ff-438a-8bd6-b45d88b499c7 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.686768 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab391fcb-a5ff-438a-8bd6-b45d88b499c7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.686768 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab391fcb-a5ff-438a-8bd6-b45d88b499c7 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.690594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 415/821] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:42.695239 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee880-44ac-463d-a2bd-49284fd231c3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.695532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee880-44ac-463d-a2bd-49284fd231c3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.695811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee880-44ac-463d-a2bd-49284fd231c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.706992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-cc364bd3-8b57-4cc4-9ccd-683548713108 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:42.708095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-cc364bd3-8b57-4cc4-9ccd-683548713108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:42.729601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-f42ee880-44ac-463d-a2bd-49284fd231c3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:42.730872 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f42ee880-44ac-463d-a2bd-49284fd231c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:42.833302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 407/822] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:42 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:42.845382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 416/823] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:42 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:42.861395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc364bd3-8b57-4cc4-9ccd-683548713108 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.870041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ee880-44ac-463d-a2bd-49284fd231c3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.873446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc364bd3-8b57-4cc4-9ccd-683548713108 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.879161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ee880-44ac-463d-a2bd-49284fd231c3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.880782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8103e7c-d72a-4ada-80d1-1579b619cfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.881781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8103e7c-d72a-4ada-80d1-1579b619cfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.882570 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8103e7c-d72a-4ada-80d1-1579b619cfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.882843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8103e7c-d72a-4ada-80d1-1579b619cfa2 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.883522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8103e7c-d72a-4ada-80d1-1579b619cfa2 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.885298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8103e7c-d72a-4ada-80d1-1579b619cfa2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.891028 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c270f-6891-43cc-a670-12df0a4f1821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.891836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c270f-6891-43cc-a670-12df0a4f1821 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.892115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c270f-6891-43cc-a670-12df0a4f1821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.892402 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c270f-6891-43cc-a670-12df0a4f1821 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.893061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c270f-6891-43cc-a670-12df0a4f1821 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.894958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c270f-6891-43cc-a670-12df0a4f1821 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.903074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-f8103e7c-d72a-4ada-80d1-1579b619cfa2 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 13:24:42.906824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 408/824] 10.222.0.83 () {56 vars in 1153 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:42.911404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8103e7c-d72a-4ada-80d1-1579b619cfa2 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.921845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-a39c270f-6891-43cc-a670-12df0a4f1821 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 13:24:42.921845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 417/825] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/services/network => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:42.927465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c270f-6891-43cc-a670-12df0a4f1821 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.929029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8103e7c-d72a-4ada-80d1-1579b619cfa2 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.934246 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babcd2a-6777-4050-b338-5c0c942a9762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.935464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babcd2a-6777-4050-b338-5c0c942a9762 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.935955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babcd2a-6777-4050-b338-5c0c942a9762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.936501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babcd2a-6777-4050-b338-5c0c942a9762 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.937520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babcd2a-6777-4050-b338-5c0c942a9762 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:42.938111 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babcd2a-6777-4050-b338-5c0c942a9762 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.939997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babcd2a-6777-4050-b338-5c0c942a9762 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.945909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c270f-6891-43cc-a670-12df0a4f1821 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.946377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 409/826] 10.222.0.83 () {56 vars in 1147 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:42.952872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babcd2a-6777-4050-b338-5c0c942a9762 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.955275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbf9db-41ec-4462-8a69-901b91fe1da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.955950 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf9db-41ec-4462-8a69-901b91fe1da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.956229 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf9db-41ec-4462-8a69-901b91fe1da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.956500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf9db-41ec-4462-8a69-901b91fe1da8 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.957278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbf9db-41ec-4462-8a69-901b91fe1da8 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:42.957527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbf9db-41ec-4462-8a69-901b91fe1da8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.959142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbf9db-41ec-4462-8a69-901b91fe1da8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.968626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 418/827] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/services?name=network => generated 124 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:42.970617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babcd2a-6777-4050-b338-5c0c942a9762 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.971713 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c4128-a1b1-4ae4-9c44-189f20996406 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.972640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c4128-a1b1-4ae4-9c44-189f20996406 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.973638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c4128-a1b1-4ae4-9c44-189f20996406 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.976573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 419/828] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:42 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:42.977780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c4128-a1b1-4ae4-9c44-189f20996406 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:42.985852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdc108-0328-4c4f-bf6c-977c0a6cc01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:42.986532 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdc108-0328-4c4f-bf6c-977c0a6cc01e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.986815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdc108-0328-4c4f-bf6c-977c0a6cc01e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:42.987092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdc108-0328-4c4f-bf6c-977c0a6cc01e admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:42.987818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdc108-0328-4c4f-bf6c-977c0a6cc01e admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:42.988124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdc108-0328-4c4f-bf6c-977c0a6cc01e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:42.989711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdc108-0328-4c4f-bf6c-977c0a6cc01e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:42.993419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c4128-a1b1-4ae4-9c44-189f20996406 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:42.995587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 410/829] 10.222.0.83 () {56 vars in 1147 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:42.996819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addaefd-8b6b-49cd-b59a-105a7e4f1216 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:42.997101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addaefd-8b6b-49cd-b59a-105a7e4f1216 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.001796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addaefd-8b6b-49cd-b59a-105a7e4f1216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.009790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95b738-4071-45e8-b230-38f075c98189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.010618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95b738-4071-45e8-b230-38f075c98189 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.012482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95b738-4071-45e8-b230-38f075c98189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.012839 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95b738-4071-45e8-b230-38f075c98189 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.013678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95b738-4071-45e8-b230-38f075c98189 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:43.014958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95b738-4071-45e8-b230-38f075c98189 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.020331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95b738-4071-45e8-b230-38f075c98189 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.032170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 420/830] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:24:42 2021] GET /identity/v3/services?type=network => generated 350 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:43.038429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95b738-4071-45e8-b230-38f075c98189 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.044929 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-0addaefd-8b6b-49cd-b59a-105a7e4f1216 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:43.047748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0addaefd-8b6b-49cd-b59a-105a7e4f1216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:43.057141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95b738-4071-45e8-b230-38f075c98189 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.067545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 411/831] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:42 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:43.070610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe169d-0d9f-4ba1-b42d-df798cbdabf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.071303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe169d-0d9f-4ba1-b42d-df798cbdabf1 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.071593 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe169d-0d9f-4ba1-b42d-df798cbdabf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.071873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe169d-0d9f-4ba1-b42d-df798cbdabf1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.072652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe169d-0d9f-4ba1-b42d-df798cbdabf1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.073690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-3fbe169d-0d9f-4ba1-b42d-df798cbdabf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:43.073690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:24:43.073690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:24:43.078819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe169d-0d9f-4ba1-b42d-df798cbdabf1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.092112 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addaefd-8b6b-49cd-b59a-105a7e4f1216 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.103364 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addaefd-8b6b-49cd-b59a-105a7e4f1216 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.109571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fe94a-3544-46e5-a2d2-f0e516c2a45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.110334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fe94a-3544-46e5-a2d2-f0e516c2a45b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.110618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fe94a-3544-46e5-a2d2-f0e516c2a45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.110889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fe94a-3544-46e5-a2d2-f0e516c2a45b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.115929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 421/832] 10.222.0.83 () {60 vars in 1165 bytes} [Wed Dec 15 13:24:43 2021] POST /identity/v3/endpoints => generated 327 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:43.118094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e690-a11c-478d-812a-2d3208f5b4d2 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.118535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e690-a11c-478d-812a-2d3208f5b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.118962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e690-a11c-478d-812a-2d3208f5b4d2 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.121300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 422/833] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:43.136673 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41073c3e-ab54-4571-b315-06da2b8a6074 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.137132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41073c3e-ab54-4571-b315-06da2b8a6074 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.137684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41073c3e-ab54-4571-b315-06da2b8a6074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.142578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fe94a-3544-46e5-a2d2-f0e516c2a45b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:43.150285 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-d53fe94a-3544-46e5-a2d2-f0e516c2a45b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:24:43.157124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 412/834] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:43.159565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fe94a-3544-46e5-a2d2-f0e516c2a45b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.171430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fe94a-3544-46e5-a2d2-f0e516c2a45b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.187627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-41073c3e-ab54-4571-b315-06da2b8a6074 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:43.191434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-41073c3e-ab54-4571-b315-06da2b8a6074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:43.202904 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51f91b-6e73-49d2-98e4-84c6bf857a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.203918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51f91b-6e73-49d2-98e4-84c6bf857a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.204449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51f91b-6e73-49d2-98e4-84c6bf857a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.204868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51f91b-6e73-49d2-98e4-84c6bf857a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.205899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51f91b-6e73-49d2-98e4-84c6bf857a1a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:43.206408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51f91b-6e73-49d2-98e4-84c6bf857a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.208446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51f91b-6e73-49d2-98e4-84c6bf857a1a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.224207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 423/836] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:43 2021] POST /identity/v3/auth/tokens => generated 1266 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:43.224457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 413/836] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:43.228423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41073c3e-ab54-4571-b315-06da2b8a6074 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.240311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41073c3e-ab54-4571-b315-06da2b8a6074 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.253018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51f91b-6e73-49d2-98e4-84c6bf857a1a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.260588 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84f54b-3ed7-4cd9-9755-a1d946daaac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.261840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84f54b-3ed7-4cd9-9755-a1d946daaac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.262283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84f54b-3ed7-4cd9-9755-a1d946daaac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.262753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84f54b-3ed7-4cd9-9755-a1d946daaac0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.264221 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51f91b-6e73-49d2-98e4-84c6bf857a1a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.268938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680d731-674b-449d-8942-3b4066a0ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.269779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680d731-674b-449d-8942-3b4066a0ec0d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.270090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680d731-674b-449d-8942-3b4066a0ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.270365 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680d731-674b-449d-8942-3b4066a0ec0d admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.271047 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680d731-674b-449d-8942-3b4066a0ec0d admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.272708 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680d731-674b-449d-8942-3b4066a0ec0d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.276287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84f54b-3ed7-4cd9-9755-a1d946daaac0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.279258 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84f54b-3ed7-4cd9-9755-a1d946daaac0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.290586 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-b680d731-674b-449d-8942-3b4066a0ec0d admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 13:24:43.291851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 414/837] 10.222.0.83 () {56 vars in 1150 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:43.298509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680d731-674b-449d-8942-3b4066a0ec0d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.302170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-6e84f54b-3ed7-4cd9-9755-a1d946daaac0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:43.304512 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 424/838] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:43.311621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84f54b-3ed7-4cd9-9755-a1d946daaac0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.313194 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680d731-674b-449d-8942-3b4066a0ec0d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.318212 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b3a1-79e6-436b-9f23-5970d1f40594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.318938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b3a1-79e6-436b-9f23-5970d1f40594 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.319258 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b3a1-79e6-436b-9f23-5970d1f40594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.319536 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b3a1-79e6-436b-9f23-5970d1f40594 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.320319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861b3a1-79e6-436b-9f23-5970d1f40594 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:43.320623 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861b3a1-79e6-436b-9f23-5970d1f40594 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.323171 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861b3a1-79e6-436b-9f23-5970d1f40594 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.337965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84f54b-3ed7-4cd9-9755-a1d946daaac0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.342058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 415/839] 10.222.0.83 () {56 vars in 1145 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:43.356636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1bdd5-081f-4eef-bae8-4dc6639f3a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.358589 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1bdd5-081f-4eef-bae8-4dc6639f3a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.359398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1bdd5-081f-4eef-bae8-4dc6639f3a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.360236 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1bdd5-081f-4eef-bae8-4dc6639f3a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.362092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1bdd5-081f-4eef-bae8-4dc6639f3a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:43.363058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1bdd5-081f-4eef-bae8-4dc6639f3a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.370385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1bdd5-081f-4eef-bae8-4dc6639f3a73 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.372135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b3a1-79e6-436b-9f23-5970d1f40594 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.393847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 425/840] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:43.395190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1bdd5-081f-4eef-bae8-4dc6639f3a73 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.404122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b3a1-79e6-436b-9f23-5970d1f40594 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.405131 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1bdd5-081f-4eef-bae8-4dc6639f3a73 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.414100 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6f362-79f1-4a13-8723-8b3dc306897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.414770 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f362-79f1-4a13-8723-8b3dc306897a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.415057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f362-79f1-4a13-8723-8b3dc306897a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.415327 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f362-79f1-4a13-8723-8b3dc306897a admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.416047 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6f362-79f1-4a13-8723-8b3dc306897a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:43.416347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6f362-79f1-4a13-8723-8b3dc306897a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.417955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6f362-79f1-4a13-8723-8b3dc306897a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.418305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b9624-0b44-43b7-b69c-2df3f089848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.419458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b9624-0b44-43b7-b69c-2df3f089848b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.419962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b9624-0b44-43b7-b69c-2df3f089848b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.420444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b9624-0b44-43b7-b69c-2df3f089848b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.426404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 416/841] 10.222.0.83 () {56 vars in 1145 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:43.429923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6f362-79f1-4a13-8723-8b3dc306897a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.435939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b9624-0b44-43b7-b69c-2df3f089848b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.438129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b9624-0b44-43b7-b69c-2df3f089848b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.440568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6f362-79f1-4a13-8723-8b3dc306897a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.446883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69c85d-fc00-43c9-9f2c-508372ac40ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.447721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69c85d-fc00-43c9-9f2c-508372ac40ff admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.448202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69c85d-fc00-43c9-9f2c-508372ac40ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.448662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69c85d-fc00-43c9-9f2c-508372ac40ff admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.449618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69c85d-fc00-43c9-9f2c-508372ac40ff admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.450869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-5e69c85d-fc00-43c9-9f2c-508372ac40ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:43.450869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:24:43.450869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:24:43.452102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69c85d-fc00-43c9-9f2c-508372ac40ff admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.455147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-dd7b9624-0b44-43b7-b69c-2df3f089848b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:24:43.461842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 426/842] 10.222.0.83 () {56 vars in 1138 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:43.465397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b9624-0b44-43b7-b69c-2df3f089848b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.478790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b9624-0b44-43b7-b69c-2df3f089848b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.481298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 417/843] 10.222.0.83 () {60 vars in 1165 bytes} [Wed Dec 15 13:24:43 2021] POST /identity/v3/endpoints => generated 346 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:43.503160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411201a-d890-4278-ad05-369c2a226407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.504150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411201a-d890-4278-ad05-369c2a226407 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.504636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411201a-d890-4278-ad05-369c2a226407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.505063 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411201a-d890-4278-ad05-369c2a226407 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.506200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411201a-d890-4278-ad05-369c2a226407 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:43.506719 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411201a-d890-4278-ad05-369c2a226407 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.509355 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411201a-d890-4278-ad05-369c2a226407 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.535045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 427/844] 10.222.0.83 () {56 vars in 1170 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:43.541454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69c85d-fc00-43c9-9f2c-508372ac40ff admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.560466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69c85d-fc00-43c9-9f2c-508372ac40ff admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.567044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5f2b9-d53a-48bd-b75e-322047133836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.567875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f2b9-d53a-48bd-b75e-322047133836 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.568287 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f2b9-d53a-48bd-b75e-322047133836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.568692 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f2b9-d53a-48bd-b75e-322047133836 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.579815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5f2b9-d53a-48bd-b75e-322047133836 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.581937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5f2b9-d53a-48bd-b75e-322047133836 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.593447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 418/845] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:43.600359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411201a-d890-4278-ad05-369c2a226407 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.620397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411201a-d890-4278-ad05-369c2a226407 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.625036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde57168-362b-4dc9-a0bb-011d6902900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.625923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde57168-362b-4dc9-a0bb-011d6902900f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.626177 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde57168-362b-4dc9-a0bb-011d6902900f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.626496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde57168-362b-4dc9-a0bb-011d6902900f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.640198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde57168-362b-4dc9-a0bb-011d6902900f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.642748 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde57168-362b-4dc9-a0bb-011d6902900f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.667164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-cde57168-362b-4dc9-a0bb-011d6902900f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:43.668754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 428/846] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:43.675177 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5f2b9-d53a-48bd-b75e-322047133836 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.687516 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5f2b9-d53a-48bd-b75e-322047133836 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.692453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a68ac5-123f-4b64-a96e-9faad6c7dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.693270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68ac5-123f-4b64-a96e-9faad6c7dc8f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.693618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68ac5-123f-4b64-a96e-9faad6c7dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.693997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68ac5-123f-4b64-a96e-9faad6c7dc8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.695878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a68ac5-123f-4b64-a96e-9faad6c7dc8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:43.696215 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a68ac5-123f-4b64-a96e-9faad6c7dc8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.697683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a68ac5-123f-4b64-a96e-9faad6c7dc8f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.716364 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 419/847] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:43.722526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde57168-362b-4dc9-a0bb-011d6902900f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.735042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde57168-362b-4dc9-a0bb-011d6902900f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.740131 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e04aeb-4be1-4bbc-adb2-ac5b25f29285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.741930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e04aeb-4be1-4bbc-adb2-ac5b25f29285 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.742449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e04aeb-4be1-4bbc-adb2-ac5b25f29285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.743001 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e04aeb-4be1-4bbc-adb2-ac5b25f29285 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.751065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e04aeb-4be1-4bbc-adb2-ac5b25f29285 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.753404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e04aeb-4be1-4bbc-adb2-ac5b25f29285 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.768247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-e8e04aeb-4be1-4bbc-adb2-ac5b25f29285 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:43.770096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 429/848] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:43.776241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a68ac5-123f-4b64-a96e-9faad6c7dc8f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.787284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a68ac5-123f-4b64-a96e-9faad6c7dc8f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.795247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1be0e-81e2-4d12-8086-3ce68275ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.795918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1be0e-81e2-4d12-8086-3ce68275ee54 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.796208 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1be0e-81e2-4d12-8086-3ce68275ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.796479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1be0e-81e2-4d12-8086-3ce68275ee54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.797281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1be0e-81e2-4d12-8086-3ce68275ee54 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:43.797594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1be0e-81e2-4d12-8086-3ce68275ee54 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.799447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1be0e-81e2-4d12-8086-3ce68275ee54 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.817876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 420/849] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:43.822132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e04aeb-4be1-4bbc-adb2-ac5b25f29285 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:43.832910 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e04aeb-4be1-4bbc-adb2-ac5b25f29285 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:43.838101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b03b81-a213-4316-a662-fa8844bba05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:43.838817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03b81-a213-4316-a662-fa8844bba05f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:43.839100 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03b81-a213-4316-a662-fa8844bba05f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:43.839378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03b81-a213-4316-a662-fa8844bba05f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:43.840287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b03b81-a213-4316-a662-fa8844bba05f admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=126a2ccd1b86445480efa0468d96960a) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:43.840599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b03b81-a213-4316-a662-fa8844bba05f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:43.842512 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b03b81-a213-4316-a662-fa8844bba05f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:43.849075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 430/850] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:43 2021] GET /identity/v3/role_assignments?user.id=126a2ccd1b86445480efa0468d96960a&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:45.202404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9f073-20d0-4219-b91f-9e213cb8e723 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.202922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9f073-20d0-4219-b91f-9e213cb8e723 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.203319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9f073-20d0-4219-b91f-9e213cb8e723 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.205884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 421/851] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:45.213976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff799c1-0a3a-49a5-a215-f178e81f3b29 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.214540 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff799c1-0a3a-49a5-a215-f178e81f3b29 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.214827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff799c1-0a3a-49a5-a215-f178e81f3b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.239401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-bff799c1-0a3a-49a5-a215-f178e81f3b29 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:45.241668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bff799c1-0a3a-49a5-a215-f178e81f3b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:45.257882 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 431/852] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:45 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:45.287968 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9f073-20d0-4219-b91f-9e213cb8e723 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.305624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9f073-20d0-4219-b91f-9e213cb8e723 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.311561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630117b-845a-470d-9eb4-3d667687ff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.312360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630117b-845a-470d-9eb4-3d667687ff15 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.312738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630117b-845a-470d-9eb4-3d667687ff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.313016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630117b-845a-470d-9eb4-3d667687ff15 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.324648 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630117b-845a-470d-9eb4-3d667687ff15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:45.331996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-d630117b-845a-470d-9eb4-3d667687ff15 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:24:45.333223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 422/853] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:45.340094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff799c1-0a3a-49a5-a215-f178e81f3b29 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.349513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff799c1-0a3a-49a5-a215-f178e81f3b29 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.354228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f52e6c-0b91-4e55-b58f-d699cb48db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.354916 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f52e6c-0b91-4e55-b58f-d699cb48db0d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.355199 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f52e6c-0b91-4e55-b58f-d699cb48db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.355473 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f52e6c-0b91-4e55-b58f-d699cb48db0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.356261 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f52e6c-0b91-4e55-b58f-d699cb48db0d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:45.356567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f52e6c-0b91-4e55-b58f-d699cb48db0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.358241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f52e6c-0b91-4e55-b58f-d699cb48db0d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.372817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 432/854] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:45.374372 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630117b-845a-470d-9eb4-3d667687ff15 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.385806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630117b-845a-470d-9eb4-3d667687ff15 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.391016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e149d-45d8-45e4-803d-bf0a5d948bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.391877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e149d-45d8-45e4-803d-bf0a5d948bdd admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.392159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e149d-45d8-45e4-803d-bf0a5d948bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.392437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e149d-45d8-45e4-803d-bf0a5d948bdd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.404319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e149d-45d8-45e4-803d-bf0a5d948bdd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.406330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e149d-45d8-45e4-803d-bf0a5d948bdd admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.424265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-e75e149d-45d8-45e4-803d-bf0a5d948bdd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:45.429860 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 423/855] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:45.432636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f52e6c-0b91-4e55-b58f-d699cb48db0d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.442949 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f52e6c-0b91-4e55-b58f-d699cb48db0d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.447651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61a5dc-415a-4e39-b3dd-1b8eff411cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.448313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61a5dc-415a-4e39-b3dd-1b8eff411cdf admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.448597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61a5dc-415a-4e39-b3dd-1b8eff411cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.448875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61a5dc-415a-4e39-b3dd-1b8eff411cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.449614 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61a5dc-415a-4e39-b3dd-1b8eff411cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:45.449953 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61a5dc-415a-4e39-b3dd-1b8eff411cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.451610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61a5dc-415a-4e39-b3dd-1b8eff411cdf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.468980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 433/856] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:45.471377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e149d-45d8-45e4-803d-bf0a5d948bdd admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.482106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e149d-45d8-45e4-803d-bf0a5d948bdd admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.487004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cde35-e85c-49c3-bdf4-3b188515ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.487800 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cde35-e85c-49c3-bdf4-3b188515ca46 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.488123 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cde35-e85c-49c3-bdf4-3b188515ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.488399 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cde35-e85c-49c3-bdf4-3b188515ca46 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.498018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cde35-e85c-49c3-bdf4-3b188515ca46 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.500189 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cde35-e85c-49c3-bdf4-3b188515ca46 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.514618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-8c6cde35-e85c-49c3-bdf4-3b188515ca46 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 13:24:45.519820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 424/857] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:45.522619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61a5dc-415a-4e39-b3dd-1b8eff411cdf admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.526831 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975456eb-f930-4308-8d1f-0edfd7839446 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.527117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975456eb-f930-4308-8d1f-0edfd7839446 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.527395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975456eb-f930-4308-8d1f-0edfd7839446 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.529517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 425/858] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:45.534754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61a5dc-415a-4e39-b3dd-1b8eff411cdf admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.535278 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbf631-a81b-4c80-a39a-f258ea50f744 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.535564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbf631-a81b-4c80-a39a-f258ea50f744 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.535840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbf631-a81b-4c80-a39a-f258ea50f744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.540030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcafd1a-f710-41d1-85fe-ffe74a7503ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.540771 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcafd1a-f710-41d1-85fe-ffe74a7503ee admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.541124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcafd1a-f710-41d1-85fe-ffe74a7503ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.541481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcafd1a-f710-41d1-85fe-ffe74a7503ee admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.542550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcafd1a-f710-41d1-85fe-ffe74a7503ee admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:45.543158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcafd1a-f710-41d1-85fe-ffe74a7503ee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.546309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcafd1a-f710-41d1-85fe-ffe74a7503ee admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.559238 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-5cfbf631-a81b-4c80-a39a-f258ea50f744 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:45.560684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-5cfbf631-a81b-4c80-a39a-f258ea50f744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:45.566904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 434/859] 10.222.0.83 () {56 vars in 1156 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:45.570249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 426/860] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:45 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:45.573190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcafd1a-f710-41d1-85fe-ffe74a7503ee admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.583494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcafd1a-f710-41d1-85fe-ffe74a7503ee admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.588802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f53c1-2561-49d5-bcfc-dc09f825fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.589479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f53c1-2561-49d5-bcfc-dc09f825fdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.589776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f53c1-2561-49d5-bcfc-dc09f825fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.590061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f53c1-2561-49d5-bcfc-dc09f825fdf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.597106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbf631-a81b-4c80-a39a-f258ea50f744 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.600631 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f53c1-2561-49d5-bcfc-dc09f825fdf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.603361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f53c1-2561-49d5-bcfc-dc09f825fdf9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.606431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbf631-a81b-4c80-a39a-f258ea50f744 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.612487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b395a0-5128-4bf3-9f2a-80f0915fc7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.613186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b395a0-5128-4bf3-9f2a-80f0915fc7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.613512 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b395a0-5128-4bf3-9f2a-80f0915fc7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.613823 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b395a0-5128-4bf3-9f2a-80f0915fc7f7 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.614743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b395a0-5128-4bf3-9f2a-80f0915fc7f7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.617003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b395a0-5128-4bf3-9f2a-80f0915fc7f7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.617678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 435/861] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:45.626365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f53c1-2561-49d5-bcfc-dc09f825fdf9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.642192 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f53c1-2561-49d5-bcfc-dc09f825fdf9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.644057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 427/862] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:24:45 2021] POST /identity/v3/services => generated 269 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:24:45.668400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf74d4-3ebb-44fd-9a42-1c4e19949ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.669656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf74d4-3ebb-44fd-9a42-1c4e19949ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.670173 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf74d4-3ebb-44fd-9a42-1c4e19949ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.670651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf74d4-3ebb-44fd-9a42-1c4e19949ea2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.683588 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf74d4-3ebb-44fd-9a42-1c4e19949ea2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.686189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf74d4-3ebb-44fd-9a42-1c4e19949ea2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.706383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-acbf74d4-3ebb-44fd-9a42-1c4e19949ea2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:45.708325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 436/863] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:45.715785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b395a0-5128-4bf3-9f2a-80f0915fc7f7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.727187 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b395a0-5128-4bf3-9f2a-80f0915fc7f7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.732466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cded9e-d53e-4afe-88a7-94b6289712e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.733436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cded9e-d53e-4afe-88a7-94b6289712e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.733940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cded9e-d53e-4afe-88a7-94b6289712e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.734455 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cded9e-d53e-4afe-88a7-94b6289712e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.735454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cded9e-d53e-4afe-88a7-94b6289712e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:45.735945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cded9e-d53e-4afe-88a7-94b6289712e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.737960 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cded9e-d53e-4afe-88a7-94b6289712e6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.752276 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 428/864] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:45.759288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf74d4-3ebb-44fd-9a42-1c4e19949ea2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.769363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf74d4-3ebb-44fd-9a42-1c4e19949ea2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.774191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52c3e1-4a81-4029-8512-9037208b46b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.775112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52c3e1-4a81-4029-8512-9037208b46b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.775445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52c3e1-4a81-4029-8512-9037208b46b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.775719 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52c3e1-4a81-4029-8512-9037208b46b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.784005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52c3e1-4a81-4029-8512-9037208b46b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.786116 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52c3e1-4a81-4029-8512-9037208b46b8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.800255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-5c52c3e1-4a81-4029-8512-9037208b46b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:45.801850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 437/865] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:45.808721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cded9e-d53e-4afe-88a7-94b6289712e6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.820522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cded9e-d53e-4afe-88a7-94b6289712e6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.825801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e154b-bd22-4ce7-be6c-ec03634f8cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.826750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e154b-bd22-4ce7-be6c-ec03634f8cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.827210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e154b-bd22-4ce7-be6c-ec03634f8cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.827634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e154b-bd22-4ce7-be6c-ec03634f8cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.828674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e154b-bd22-4ce7-be6c-ec03634f8cd9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:45.829472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e154b-bd22-4ce7-be6c-ec03634f8cd9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.833489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e154b-bd22-4ce7-be6c-ec03634f8cd9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.858030 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 429/866] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:45.861236 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52c3e1-4a81-4029-8512-9037208b46b8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:45.873246 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52c3e1-4a81-4029-8512-9037208b46b8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:45.878071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73f210-bd40-49da-9979-7eb6308df1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:45.878883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73f210-bd40-49da-9979-7eb6308df1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:45.879328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73f210-bd40-49da-9979-7eb6308df1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:45.879746 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73f210-bd40-49da-9979-7eb6308df1c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:45.880767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73f210-bd40-49da-9979-7eb6308df1c5 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=93ec8ea8a0904d30b6a95c8ebc9dd634) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:45.881079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73f210-bd40-49da-9979-7eb6308df1c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:45.883621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73f210-bd40-49da-9979-7eb6308df1c5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:45.891040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 438/867] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:45 2021] GET /identity/v3/role_assignments?user.id=93ec8ea8a0904d30b6a95c8ebc9dd634&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=a312b345efeb490eb4234d1ace386dec => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:46.349068 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f211af-34fd-4a29-a2db-50a83888af06 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.349626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f211af-34fd-4a29-a2db-50a83888af06 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.349626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f211af-34fd-4a29-a2db-50a83888af06 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.352965 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 430/868] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:46.362333 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883abc3f-2b24-4e86-a5e3-7dce4426bb9d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.362887 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883abc3f-2b24-4e86-a5e3-7dce4426bb9d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.363292 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883abc3f-2b24-4e86-a5e3-7dce4426bb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.388995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-883abc3f-2b24-4e86-a5e3-7dce4426bb9d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:46.390851 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-883abc3f-2b24-4e86-a5e3-7dce4426bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:46.400343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 439/869] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:46 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:46.429040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f211af-34fd-4a29-a2db-50a83888af06 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:46.441855 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f211af-34fd-4a29-a2db-50a83888af06 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:46.446829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae00818-d500-4458-b553-38541546f628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:46.447629 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00818-d500-4458-b553-38541546f628 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.447905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00818-d500-4458-b553-38541546f628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.448177 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00818-d500-4458-b553-38541546f628 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.448852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae00818-d500-4458-b553-38541546f628 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:46.450470 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae00818-d500-4458-b553-38541546f628 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:46.463106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-4ae00818-d500-4458-b553-38541546f628 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 13:24:46.464582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 431/870] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:46 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:46.470973 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883abc3f-2b24-4e86-a5e3-7dce4426bb9d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:46.486301 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883abc3f-2b24-4e86-a5e3-7dce4426bb9d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:46.493375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a03109-ad01-4289-8e67-e492d6f32a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:46.494513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a03109-ad01-4289-8e67-e492d6f32a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.495009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a03109-ad01-4289-8e67-e492d6f32a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.495466 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a03109-ad01-4289-8e67-e492d6f32a56 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.496800 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a03109-ad01-4289-8e67-e492d6f32a56 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:46.497421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a03109-ad01-4289-8e67-e492d6f32a56 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:46.500447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a03109-ad01-4289-8e67-e492d6f32a56 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:46.506179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 440/871] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:46 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:46.514014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae00818-d500-4458-b553-38541546f628 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:46.526557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae00818-d500-4458-b553-38541546f628 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:46.531742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eafe04-b4f8-4cb3-b512-05540b1d986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:46.532403 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eafe04-b4f8-4cb3-b512-05540b1d986e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.532680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eafe04-b4f8-4cb3-b512-05540b1d986e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.532954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eafe04-b4f8-4cb3-b512-05540b1d986e admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.533672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eafe04-b4f8-4cb3-b512-05540b1d986e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:46.534013 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eafe04-b4f8-4cb3-b512-05540b1d986e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:46.535600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eafe04-b4f8-4cb3-b512-05540b1d986e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:46.540786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 432/872] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:46 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:46.582507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7e413-30f5-4817-b46c-1a2667967a35 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.582850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7e413-30f5-4817-b46c-1a2667967a35 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.583061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7e413-30f5-4817-b46c-1a2667967a35 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.585246 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 441/873] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:46.591876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb196ed5-dc4b-4b7b-bc8f-8dd87e4f3b96 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.592251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb196ed5-dc4b-4b7b-bc8f-8dd87e4f3b96 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.592600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb196ed5-dc4b-4b7b-bc8f-8dd87e4f3b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.613497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-cb196ed5-dc4b-4b7b-bc8f-8dd87e4f3b96 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:46.614926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-cb196ed5-dc4b-4b7b-bc8f-8dd87e4f3b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:46.624244 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 433/874] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:46 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:46.652893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7e413-30f5-4817-b46c-1a2667967a35 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:46.666805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7e413-30f5-4817-b46c-1a2667967a35 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:46.672073 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bd138-c1b1-4c3a-91e6-3df864f125ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:46.673031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bd138-c1b1-4c3a-91e6-3df864f125ac admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.673306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bd138-c1b1-4c3a-91e6-3df864f125ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.673626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bd138-c1b1-4c3a-91e6-3df864f125ac admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.688737 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bd138-c1b1-4c3a-91e6-3df864f125ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:46.697813 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-6f3bd138-c1b1-4c3a-91e6-3df864f125ac admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:24:46.700293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 442/875] 10.222.0.83 () {56 vars in 1141 bytes} [Wed Dec 15 13:24:46 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:46.707584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb196ed5-dc4b-4b7b-bc8f-8dd87e4f3b96 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:46.717330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb196ed5-dc4b-4b7b-bc8f-8dd87e4f3b96 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:46.722144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca919f4b-3b40-4615-a3cd-bc1c538d7dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:46.722888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919f4b-3b40-4615-a3cd-bc1c538d7dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.723164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919f4b-3b40-4615-a3cd-bc1c538d7dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.723435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919f4b-3b40-4615-a3cd-bc1c538d7dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.724266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca919f4b-3b40-4615-a3cd-bc1c538d7dc9 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:46.724568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca919f4b-3b40-4615-a3cd-bc1c538d7dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:46.726316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca919f4b-3b40-4615-a3cd-bc1c538d7dc9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:46.745275 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 434/876] 10.222.0.83 () {56 vars in 1136 bytes} [Wed Dec 15 13:24:46 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:46.755358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bd138-c1b1-4c3a-91e6-3df864f125ac admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:46.768348 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bd138-c1b1-4c3a-91e6-3df864f125ac admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:46.774438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103647e-9a5a-4961-933d-b60ccc84f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:46.775320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103647e-9a5a-4961-933d-b60ccc84f093 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.775594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103647e-9a5a-4961-933d-b60ccc84f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.775952 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103647e-9a5a-4961-933d-b60ccc84f093 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.789284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103647e-9a5a-4961-933d-b60ccc84f093 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:46.791213 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103647e-9a5a-4961-933d-b60ccc84f093 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:46.813216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-9103647e-9a5a-4961-933d-b60ccc84f093 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:46.814816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 443/877] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:46.823940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca919f4b-3b40-4615-a3cd-bc1c538d7dc9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:46.839170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca919f4b-3b40-4615-a3cd-bc1c538d7dc9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:46.845046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff9b08-ef19-4999-811d-257bd58f08f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:46.846105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff9b08-ef19-4999-811d-257bd58f08f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.846592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff9b08-ef19-4999-811d-257bd58f08f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.847143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff9b08-ef19-4999-811d-257bd58f08f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.848576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff9b08-ef19-4999-811d-257bd58f08f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:46.849121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff9b08-ef19-4999-811d-257bd58f08f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:46.851320 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff9b08-ef19-4999-811d-257bd58f08f5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:46.865376 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 435/878] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:46.874660 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103647e-9a5a-4961-933d-b60ccc84f093 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:46.888733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103647e-9a5a-4961-933d-b60ccc84f093 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:46.894930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d06f41-bc44-4fc1-947c-855bbe58a492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:46.895806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d06f41-bc44-4fc1-947c-855bbe58a492 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.896090 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d06f41-bc44-4fc1-947c-855bbe58a492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.896506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d06f41-bc44-4fc1-947c-855bbe58a492 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.909323 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d06f41-bc44-4fc1-947c-855bbe58a492 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:46.911457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d06f41-bc44-4fc1-947c-855bbe58a492 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:46.932544 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-a2d06f41-bc44-4fc1-947c-855bbe58a492 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:24:46.935506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 444/879] 10.222.0.83 () {56 vars in 1138 bytes} [Wed Dec 15 13:24:46 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:46.944530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff9b08-ef19-4999-811d-257bd58f08f5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:46.956232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff9b08-ef19-4999-811d-257bd58f08f5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:46.965240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847c40e-b9d5-42e7-88e2-1d40cabe4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:46.966001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847c40e-b9d5-42e7-88e2-1d40cabe4ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:46.966277 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847c40e-b9d5-42e7-88e2-1d40cabe4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:46.966585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847c40e-b9d5-42e7-88e2-1d40cabe4ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:46.967495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847c40e-b9d5-42e7-88e2-1d40cabe4ce0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:46.967797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847c40e-b9d5-42e7-88e2-1d40cabe4ce0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:46.970320 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847c40e-b9d5-42e7-88e2-1d40cabe4ce0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:46.992468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 436/880] 10.222.0.83 () {56 vars in 1170 bytes} [Wed Dec 15 13:24:46 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:46.999057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d06f41-bc44-4fc1-947c-855bbe58a492 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:47.009417 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d06f41-bc44-4fc1-947c-855bbe58a492 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:47.015441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b597b-5ea8-4e8c-9a0d-0a77315ac6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:47.016835 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b597b-5ea8-4e8c-9a0d-0a77315ac6bc admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:47.017542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b597b-5ea8-4e8c-9a0d-0a77315ac6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:47.018322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b597b-5ea8-4e8c-9a0d-0a77315ac6bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:47.031370 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b597b-5ea8-4e8c-9a0d-0a77315ac6bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:47.033429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b597b-5ea8-4e8c-9a0d-0a77315ac6bc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:47.044142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 445/881] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:46 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:24:47.053779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847c40e-b9d5-42e7-88e2-1d40cabe4ce0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:47.065158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847c40e-b9d5-42e7-88e2-1d40cabe4ce0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:47.071478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfb4ab-73bb-4c58-ba18-15f1d4e44f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:47.073042 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfb4ab-73bb-4c58-ba18-15f1d4e44f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:47.073734 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfb4ab-73bb-4c58-ba18-15f1d4e44f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:47.074444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfb4ab-73bb-4c58-ba18-15f1d4e44f51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:47.087345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfb4ab-73bb-4c58-ba18-15f1d4e44f51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:47.089436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfb4ab-73bb-4c58-ba18-15f1d4e44f51 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:47.108126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-f7dfb4ab-73bb-4c58-ba18-15f1d4e44f51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:47.109910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 437/882] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:47.119120 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b597b-5ea8-4e8c-9a0d-0a77315ac6bc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:47.138225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b597b-5ea8-4e8c-9a0d-0a77315ac6bc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:47.146108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f877-04f7-40e6-943f-4de64990763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:47.147233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f877-04f7-40e6-943f-4de64990763b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:47.147825 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f877-04f7-40e6-943f-4de64990763b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:47.148321 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f877-04f7-40e6-943f-4de64990763b admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:47.149666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f877-04f7-40e6-943f-4de64990763b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:47.150238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f877-04f7-40e6-943f-4de64990763b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:47.153279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f877-04f7-40e6-943f-4de64990763b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:47.175219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 446/883] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:47.186268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfb4ab-73bb-4c58-ba18-15f1d4e44f51 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:47.203367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfb4ab-73bb-4c58-ba18-15f1d4e44f51 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:47.211121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e6153-4ca1-4268-9739-8b0aefe8ca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:47.212544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e6153-4ca1-4268-9739-8b0aefe8ca31 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:47.213075 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e6153-4ca1-4268-9739-8b0aefe8ca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:47.213626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e6153-4ca1-4268-9739-8b0aefe8ca31 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:47.227587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e6153-4ca1-4268-9739-8b0aefe8ca31 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:47.231735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e6153-4ca1-4268-9739-8b0aefe8ca31 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:47.258097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-a73e6153-4ca1-4268-9739-8b0aefe8ca31 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:47.260626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 438/884] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:47.271230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f877-04f7-40e6-943f-4de64990763b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:47.289705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f877-04f7-40e6-943f-4de64990763b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:47.297632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce6171-6da3-4500-bad9-38f08aab4013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:47.298936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce6171-6da3-4500-bad9-38f08aab4013 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:47.299503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce6171-6da3-4500-bad9-38f08aab4013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:47.299994 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce6171-6da3-4500-bad9-38f08aab4013 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:47.301555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce6171-6da3-4500-bad9-38f08aab4013 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:47.302141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce6171-6da3-4500-bad9-38f08aab4013 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:47.305923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce6171-6da3-4500-bad9-38f08aab4013 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:47.329286 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 447/885] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:47.340166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e6153-4ca1-4268-9739-8b0aefe8ca31 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:47.353010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e6153-4ca1-4268-9739-8b0aefe8ca31 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:47.358307 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c76857-df69-420a-9606-3c8224f90054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:47.359252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c76857-df69-420a-9606-3c8224f90054 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:47.359533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c76857-df69-420a-9606-3c8224f90054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:47.359860 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c76857-df69-420a-9606-3c8224f90054 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:47.361424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c76857-df69-420a-9606-3c8224f90054 admin admin] RBAC: Adding query filter params (role.id=8527ff64b4bd4649a23f8fb0d079d8b4, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=126a2ccd1b86445480efa0468d96960a) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:47.361767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c76857-df69-420a-9606-3c8224f90054 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:47.363703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c76857-df69-420a-9606-3c8224f90054 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:47.372826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 439/886] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:47 2021] GET /identity/v3/role_assignments?user.id=126a2ccd1b86445480efa0468d96960a&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=8527ff64b4bd4649a23f8fb0d079d8b4 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:48.190644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdc49a-72e6-45b0-b0aa-2c92d0c11e97 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.191685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdc49a-72e6-45b0-b0aa-2c92d0c11e97 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.192187 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdc49a-72e6-45b0-b0aa-2c92d0c11e97 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.195226 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 448/887] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:48.201697 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2460e-bfa4-4031-9fa3-f619b9e4a7ae None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.202270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2460e-bfa4-4031-9fa3-f619b9e4a7ae None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.202771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2460e-bfa4-4031-9fa3-f619b9e4a7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.221031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e9b2460e-bfa4-4031-9fa3-f619b9e4a7ae None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:48.225534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e9b2460e-bfa4-4031-9fa3-f619b9e4a7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:48.231703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 440/888] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:48 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:48.255974 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdc49a-72e6-45b0-b0aa-2c92d0c11e97 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:48.269225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdc49a-72e6-45b0-b0aa-2c92d0c11e97 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:48.273946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05dc39-176d-4215-b049-ecb8f6803a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:48.274991 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05dc39-176d-4215-b049-ecb8f6803a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.275463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05dc39-176d-4215-b049-ecb8f6803a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.275948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05dc39-176d-4215-b049-ecb8f6803a80 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.276800 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05dc39-176d-4215-b049-ecb8f6803a80 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:48.278602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05dc39-176d-4215-b049-ecb8f6803a80 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:48.291684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-be05dc39-176d-4215-b049-ecb8f6803a80 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 13:24:48.297870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 449/889] 10.222.0.83 () {56 vars in 1153 bytes} [Wed Dec 15 13:24:48 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:48.300700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2460e-bfa4-4031-9fa3-f619b9e4a7ae None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:48.313217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2460e-bfa4-4031-9fa3-f619b9e4a7ae None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:48.319993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9c43-0810-4f55-975c-34cbbc3f4249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:48.320872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9c43-0810-4f55-975c-34cbbc3f4249 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.321344 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9c43-0810-4f55-975c-34cbbc3f4249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.321874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9c43-0810-4f55-975c-34cbbc3f4249 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.322820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba9c43-0810-4f55-975c-34cbbc3f4249 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:48.323456 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba9c43-0810-4f55-975c-34cbbc3f4249 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:48.325225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba9c43-0810-4f55-975c-34cbbc3f4249 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:48.336279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 441/890] 10.222.0.83 () {56 vars in 1147 bytes} [Wed Dec 15 13:24:48 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:48.338250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05dc39-176d-4215-b049-ecb8f6803a80 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:48.348518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05dc39-176d-4215-b049-ecb8f6803a80 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:48.353263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d0536-6cf2-434f-b478-203dac5d14cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:48.354173 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d0536-6cf2-434f-b478-203dac5d14cd admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.354650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d0536-6cf2-434f-b478-203dac5d14cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.355134 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d0536-6cf2-434f-b478-203dac5d14cd admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.356081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d0536-6cf2-434f-b478-203dac5d14cd admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:48.356581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d0536-6cf2-434f-b478-203dac5d14cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:48.358400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d0536-6cf2-434f-b478-203dac5d14cd admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:48.369884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 450/891] 10.222.0.83 () {56 vars in 1147 bytes} [Wed Dec 15 13:24:48 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:48.371802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9c43-0810-4f55-975c-34cbbc3f4249 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:48.383813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9c43-0810-4f55-975c-34cbbc3f4249 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:48.388813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d6319-024d-4f3a-8a9c-c028a8094b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:48.389851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d6319-024d-4f3a-8a9c-c028a8094b6c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.390350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d6319-024d-4f3a-8a9c-c028a8094b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.390823 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d6319-024d-4f3a-8a9c-c028a8094b6c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.391811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d6319-024d-4f3a-8a9c-c028a8094b6c admin admin] RBAC: Adding query filter params (interface=public, service_id=670b08e327074d9297e022f87727c3e2, region_id=RegionOne) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:48.392341 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d6319-024d-4f3a-8a9c-c028a8094b6c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:48.393652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-200d6319-024d-4f3a-8a9c-c028a8094b6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:48.393652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:24:48.393652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:24:48.395058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d6319-024d-4f3a-8a9c-c028a8094b6c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:48.409165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 442/892] 10.222.0.83 () {56 vars in 1272 bytes} [Wed Dec 15 13:24:48 2021] GET /identity/v3/endpoints?service_id=670b08e327074d9297e022f87727c3e2&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:48.411103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d0536-6cf2-434f-b478-203dac5d14cd admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:48.422103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d0536-6cf2-434f-b478-203dac5d14cd admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:48.427394 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ad8e2-f5fc-4c7b-9baa-761b335a9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:48.428444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ad8e2-f5fc-4c7b-9baa-761b335a9c9b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.429464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ad8e2-f5fc-4c7b-9baa-761b335a9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.429962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ad8e2-f5fc-4c7b-9baa-761b335a9c9b admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.430843 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ad8e2-f5fc-4c7b-9baa-761b335a9c9b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:48.432686 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ad8e2-f5fc-4c7b-9baa-761b335a9c9b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:48.445873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 451/893] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Dec 15 13:24:48 2021] GET /identity/v3/services => generated 1029 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:24:48.590785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef01f6-9f99-4dbf-82de-2658993e92ed None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.591135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef01f6-9f99-4dbf-82de-2658993e92ed None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.591345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef01f6-9f99-4dbf-82de-2658993e92ed None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.593572 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 443/894] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:48.600044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a69c0e-6bbe-4912-9a91-38300f9e287f None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.600353 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a69c0e-6bbe-4912-9a91-38300f9e287f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.601165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a69c0e-6bbe-4912-9a91-38300f9e287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.620954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-c6a69c0e-6bbe-4912-9a91-38300f9e287f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:48.622219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c6a69c0e-6bbe-4912-9a91-38300f9e287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:48.630848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 452/895] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:48 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:48.655238 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef01f6-9f99-4dbf-82de-2658993e92ed None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:48.668973 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef01f6-9f99-4dbf-82de-2658993e92ed None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:48.673551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0a82c-9cd6-4373-a730-f9d3e225c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:48.674392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0a82c-9cd6-4373-a730-f9d3e225c8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.674675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0a82c-9cd6-4373-a730-f9d3e225c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.674951 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0a82c-9cd6-4373-a730-f9d3e225c8a6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.675677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0a82c-9cd6-4373-a730-f9d3e225c8a6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:48.677344 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0a82c-9cd6-4373-a730-f9d3e225c8a6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:48.690444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-37d0a82c-9cd6-4373-a730-f9d3e225c8a6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 13:24:48.691955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 444/896] 10.222.0.83 () {56 vars in 1147 bytes} [Wed Dec 15 13:24:48 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:48.699381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a69c0e-6bbe-4912-9a91-38300f9e287f None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:48.709094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a69c0e-6bbe-4912-9a91-38300f9e287f None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:48.714110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842cc12-374b-4437-bba2-1419e2fdfe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:48.715048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842cc12-374b-4437-bba2-1419e2fdfe4f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.715439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842cc12-374b-4437-bba2-1419e2fdfe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.715827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842cc12-374b-4437-bba2-1419e2fdfe4f admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.716668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842cc12-374b-4437-bba2-1419e2fdfe4f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:48.717121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842cc12-374b-4437-bba2-1419e2fdfe4f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:48.719007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842cc12-374b-4437-bba2-1419e2fdfe4f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:48.726116 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 453/897] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Dec 15 13:24:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:48.732185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0a82c-9cd6-4373-a730-f9d3e225c8a6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:48.743715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0a82c-9cd6-4373-a730-f9d3e225c8a6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:48.748526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303b870-74d3-49f3-b607-790b74cbc002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:48.749469 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b870-74d3-49f3-b607-790b74cbc002 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:48.749989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b870-74d3-49f3-b607-790b74cbc002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:48.750468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b870-74d3-49f3-b607-790b74cbc002 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:48.751410 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303b870-74d3-49f3-b607-790b74cbc002 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:48.751924 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303b870-74d3-49f3-b607-790b74cbc002 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:48.753803 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303b870-74d3-49f3-b607-790b74cbc002 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:48.765921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 445/898] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Dec 15 13:24:48 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:49.310915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50d424-1c8e-459d-9a73-2ea47c3fb947 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:49.311429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50d424-1c8e-459d-9a73-2ea47c3fb947 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:49.311502 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50d424-1c8e-459d-9a73-2ea47c3fb947 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:49.313671 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 454/899] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:49.320324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a230ea-d11d-4510-9f5f-be92613d3af4 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:49.320606 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a230ea-d11d-4510-9f5f-be92613d3af4 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:49.320881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a230ea-d11d-4510-9f5f-be92613d3af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:49.339844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d8a230ea-d11d-4510-9f5f-be92613d3af4 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:49.341191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d8a230ea-d11d-4510-9f5f-be92613d3af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:49.353665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 446/900] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:49 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:49.378867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50d424-1c8e-459d-9a73-2ea47c3fb947 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:49.394173 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50d424-1c8e-459d-9a73-2ea47c3fb947 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:49.402658 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449638db-139f-46be-9009-7f1d837a3e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:49.403376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449638db-139f-46be-9009-7f1d837a3e08 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:49.403819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449638db-139f-46be-9009-7f1d837a3e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:49.404106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449638db-139f-46be-9009-7f1d837a3e08 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:49.404961 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449638db-139f-46be-9009-7f1d837a3e08 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:49.406720 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449638db-139f-46be-9009-7f1d837a3e08 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:49.423423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 455/901] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:24:49 2021] POST /identity/v3/services => generated 251 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:49.825505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fd542-1d0f-4d5b-92ae-495e030613d0 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:49.826113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fd542-1d0f-4d5b-92ae-495e030613d0 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:49.826596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fd542-1d0f-4d5b-92ae-495e030613d0 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:49.829591 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 447/902] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:49.836424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922f6f-95d7-4600-a280-dd4e4949b181 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:49.837162 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922f6f-95d7-4600-a280-dd4e4949b181 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:49.837654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922f6f-95d7-4600-a280-dd4e4949b181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:49.857228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-7c922f6f-95d7-4600-a280-dd4e4949b181 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:49.858883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7c922f6f-95d7-4600-a280-dd4e4949b181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:49.881895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 456/903] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:49 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:49.904602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fd542-1d0f-4d5b-92ae-495e030613d0 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:49.921705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fd542-1d0f-4d5b-92ae-495e030613d0 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:49.926620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1876614-e1a1-4a79-b629-4d1da9010091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:49.927740 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876614-e1a1-4a79-b629-4d1da9010091 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:49.928195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876614-e1a1-4a79-b629-4d1da9010091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:49.928703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876614-e1a1-4a79-b629-4d1da9010091 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:49.941211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1876614-e1a1-4a79-b629-4d1da9010091 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:49.949113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-f1876614-e1a1-4a79-b629-4d1da9010091 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:24:49.956365 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 448/904] 10.222.0.83 () {56 vars in 1141 bytes} [Wed Dec 15 13:24:49 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:49.958144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c922f6f-95d7-4600-a280-dd4e4949b181 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:49.968584 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c922f6f-95d7-4600-a280-dd4e4949b181 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:49.973444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dcc56-c889-4d94-a433-f54d4c9222cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:49.974454 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dcc56-c889-4d94-a433-f54d4c9222cc admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:49.974935 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dcc56-c889-4d94-a433-f54d4c9222cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:49.975379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dcc56-c889-4d94-a433-f54d4c9222cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:49.976850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dcc56-c889-4d94-a433-f54d4c9222cc admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:49.977356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dcc56-c889-4d94-a433-f54d4c9222cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:49.979165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dcc56-c889-4d94-a433-f54d4c9222cc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:49.993870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 457/905] 10.222.0.83 () {56 vars in 1136 bytes} [Wed Dec 15 13:24:49 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:49.996428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1876614-e1a1-4a79-b629-4d1da9010091 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:50.006701 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1876614-e1a1-4a79-b629-4d1da9010091 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:50.011611 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19cfba-5474-43d6-a4c4-a5120d25ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:50.012648 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19cfba-5474-43d6-a4c4-a5120d25ae5e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:50.013129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19cfba-5474-43d6-a4c4-a5120d25ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:50.013573 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19cfba-5474-43d6-a4c4-a5120d25ae5e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:50.025668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19cfba-5474-43d6-a4c4-a5120d25ae5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:50.027837 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19cfba-5474-43d6-a4c4-a5120d25ae5e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:50.045997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-2a19cfba-5474-43d6-a4c4-a5120d25ae5e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:50.047941 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 449/906] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:50.054517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dcc56-c889-4d94-a433-f54d4c9222cc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:50.065191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dcc56-c889-4d94-a433-f54d4c9222cc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:50.070191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b4438-cd73-4154-8467-2dacc759021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:50.070976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b4438-cd73-4154-8467-2dacc759021e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:50.071351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b4438-cd73-4154-8467-2dacc759021e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:50.071708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b4438-cd73-4154-8467-2dacc759021e admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:50.072534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b4438-cd73-4154-8467-2dacc759021e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:50.072912 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b4438-cd73-4154-8467-2dacc759021e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:50.074669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b4438-cd73-4154-8467-2dacc759021e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:50.093618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 458/907] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:50.099355 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19cfba-5474-43d6-a4c4-a5120d25ae5e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:50.111746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19cfba-5474-43d6-a4c4-a5120d25ae5e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:50.117506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cdefd-ee15-4187-aa82-da7e6b9b91b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:50.118612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cdefd-ee15-4187-aa82-da7e6b9b91b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:50.119120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cdefd-ee15-4187-aa82-da7e6b9b91b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:50.119584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cdefd-ee15-4187-aa82-da7e6b9b91b2 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:50.128488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cdefd-ee15-4187-aa82-da7e6b9b91b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:50.130944 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cdefd-ee15-4187-aa82-da7e6b9b91b2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:50.146930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-ea6cdefd-ee15-4187-aa82-da7e6b9b91b2 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:24:50.149460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 450/908] 10.222.0.83 () {56 vars in 1138 bytes} [Wed Dec 15 13:24:50 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:50.155968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b4438-cd73-4154-8467-2dacc759021e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:50.167102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b4438-cd73-4154-8467-2dacc759021e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:50.173980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f772f3-4fd5-4cb1-8aea-dca348cea7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:50.175606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f772f3-4fd5-4cb1-8aea-dca348cea7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:50.176355 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f772f3-4fd5-4cb1-8aea-dca348cea7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:50.177152 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f772f3-4fd5-4cb1-8aea-dca348cea7b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:50.179124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f772f3-4fd5-4cb1-8aea-dca348cea7b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:50.179996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f772f3-4fd5-4cb1-8aea-dca348cea7b3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:50.183909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f772f3-4fd5-4cb1-8aea-dca348cea7b3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:50.220799 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 459/909] 10.222.0.83 () {56 vars in 1170 bytes} [Wed Dec 15 13:24:50 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:50.227207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cdefd-ee15-4187-aa82-da7e6b9b91b2 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:50.238056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cdefd-ee15-4187-aa82-da7e6b9b91b2 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:50.243719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b1abd-decc-4d74-a663-5ab39cda4828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:50.244801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b1abd-decc-4d74-a663-5ab39cda4828 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:50.245313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b1abd-decc-4d74-a663-5ab39cda4828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:50.245971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b1abd-decc-4d74-a663-5ab39cda4828 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:50.258332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b1abd-decc-4d74-a663-5ab39cda4828 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:50.260669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b1abd-decc-4d74-a663-5ab39cda4828 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:50.282380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-058b1abd-decc-4d74-a663-5ab39cda4828 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:50.284287 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 451/910] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:50.295499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f772f3-4fd5-4cb1-8aea-dca348cea7b3 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:50.312985 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f772f3-4fd5-4cb1-8aea-dca348cea7b3 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:50.320440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091baf1-c54d-4c90-83f1-e9b30b01f066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:50.321535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091baf1-c54d-4c90-83f1-e9b30b01f066 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:50.322051 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091baf1-c54d-4c90-83f1-e9b30b01f066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:50.322514 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091baf1-c54d-4c90-83f1-e9b30b01f066 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:50.323816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091baf1-c54d-4c90-83f1-e9b30b01f066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:50.324333 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091baf1-c54d-4c90-83f1-e9b30b01f066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:50.327203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091baf1-c54d-4c90-83f1-e9b30b01f066 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:50.349229 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 460/911] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:50.355723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b1abd-decc-4d74-a663-5ab39cda4828 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:50.366275 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b1abd-decc-4d74-a663-5ab39cda4828 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:50.371353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d8364-f145-437d-a58d-b40f497a54a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:50.372423 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d8364-f145-437d-a58d-b40f497a54a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:50.372923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d8364-f145-437d-a58d-b40f497a54a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:50.373416 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d8364-f145-437d-a58d-b40f497a54a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:50.380974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d8364-f145-437d-a58d-b40f497a54a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:50.383263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d8364-f145-437d-a58d-b40f497a54a0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:50.398853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-5c0d8364-f145-437d-a58d-b40f497a54a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:50.400765 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 452/912] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:50.407270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091baf1-c54d-4c90-83f1-e9b30b01f066 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:50.419021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091baf1-c54d-4c90-83f1-e9b30b01f066 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:50.424284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dbff8-5e51-4eb2-a498-8637e0556ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:50.425285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dbff8-5e51-4eb2-a498-8637e0556ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:50.425816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dbff8-5e51-4eb2-a498-8637e0556ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:50.426358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dbff8-5e51-4eb2-a498-8637e0556ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:50.427365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dbff8-5e51-4eb2-a498-8637e0556ce9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:50.427975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dbff8-5e51-4eb2-a498-8637e0556ce9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:50.430195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dbff8-5e51-4eb2-a498-8637e0556ce9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:50.445182 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 461/913] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:50.452450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d8364-f145-437d-a58d-b40f497a54a0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:50.464413 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d8364-f145-437d-a58d-b40f497a54a0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:50.469808 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001d8a5-c6be-466a-847b-f6a024cda358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:50.471173 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d8a5-c6be-466a-847b-f6a024cda358 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:50.471719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d8a5-c6be-466a-847b-f6a024cda358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:50.472208 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d8a5-c6be-466a-847b-f6a024cda358 admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/126a2ccd1b86445480efa0468d96960a/roles/8527ff64b4bd4649a23f8fb0d079d8b4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:50.474960 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001d8a5-c6be-466a-847b-f6a024cda358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=126a2ccd1b86445480efa0468d96960a, role_id=8527ff64b4bd4649a23f8fb0d079d8b4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:50.478564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001d8a5-c6be-466a-847b-f6a024cda358 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:50.494526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 453/914] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:24:50 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/126a2ccd1b86445480efa0468d96960a/roles/8527ff64b4bd4649a23f8fb0d079d8b4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:24:51.222714 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fff4e-7750-4afa-9ae4-cbec4e8f4f95 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:51.223055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fff4e-7750-4afa-9ae4-cbec4e8f4f95 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:51.223392 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fff4e-7750-4afa-9ae4-cbec4e8f4f95 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:51.225539 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 462/915] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:51.231991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01393bf8-5461-4fe3-b6cb-f36509acdcb5 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:51.232504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01393bf8-5461-4fe3-b6cb-f36509acdcb5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:51.232578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01393bf8-5461-4fe3-b6cb-f36509acdcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:51.251814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-01393bf8-5461-4fe3-b6cb-f36509acdcb5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:51.253036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-01393bf8-5461-4fe3-b6cb-f36509acdcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:51.284579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b8e2-b61d-4f15-9f67-3e75f61b3460 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:51.284875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b8e2-b61d-4f15-9f67-3e75f61b3460 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:51.285161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b8e2-b61d-4f15-9f67-3e75f61b3460 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:51.287253 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 463/916] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:51.293372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e875058-67b4-456a-a5ed-0807182dc8b6 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:51.293670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e875058-67b4-456a-a5ed-0807182dc8b6 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:51.293977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e875058-67b4-456a-a5ed-0807182dc8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:51.314302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8e875058-67b4-456a-a5ed-0807182dc8b6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:51.315555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8e875058-67b4-456a-a5ed-0807182dc8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:51.329929 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 454/917] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:51 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:51.353460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01393bf8-5461-4fe3-b6cb-f36509acdcb5 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:51.365072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01393bf8-5461-4fe3-b6cb-f36509acdcb5 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:51.371588 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8100d8a-5dcf-417f-bc94-54fb08ed4706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:51.372736 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8100d8a-5dcf-417f-bc94-54fb08ed4706 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:51.373086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8100d8a-5dcf-417f-bc94-54fb08ed4706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:51.373259 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8100d8a-5dcf-417f-bc94-54fb08ed4706 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:51.374737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8100d8a-5dcf-417f-bc94-54fb08ed4706 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:51.377051 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8100d8a-5dcf-417f-bc94-54fb08ed4706 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:51.397902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 455/918] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:24:51 2021] POST /identity/v3/services => generated 241 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:24:51.425427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 464/919] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:51 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:51.466936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8100d8a-5dcf-417f-bc94-54fb08ed4706 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:51.487265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8100d8a-5dcf-417f-bc94-54fb08ed4706 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:51.494357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ffdc2-1218-4193-9a9e-3ee96d817338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:51.495275 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ffdc2-1218-4193-9a9e-3ee96d817338 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:51.495557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ffdc2-1218-4193-9a9e-3ee96d817338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:51.495832 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ffdc2-1218-4193-9a9e-3ee96d817338 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:51.497793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ffdc2-1218-4193-9a9e-3ee96d817338 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:51.499544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ffdc2-1218-4193-9a9e-3ee96d817338 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:51.514004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-567ffdc2-1218-4193-9a9e-3ee96d817338 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 13:24:51.515658 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 456/920] 10.222.0.83 () {56 vars in 1153 bytes} [Wed Dec 15 13:24:51 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:51.522264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e875058-67b4-456a-a5ed-0807182dc8b6 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:51.533031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e875058-67b4-456a-a5ed-0807182dc8b6 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:51.540783 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41248b-f41c-4d60-acea-3833a3e7e848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:51.544201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41248b-f41c-4d60-acea-3833a3e7e848 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:51.545059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41248b-f41c-4d60-acea-3833a3e7e848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:51.545822 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41248b-f41c-4d60-acea-3833a3e7e848 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:51.547285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41248b-f41c-4d60-acea-3833a3e7e848 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:51.548036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41248b-f41c-4d60-acea-3833a3e7e848 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:51.551100 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41248b-f41c-4d60-acea-3833a3e7e848 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:51.559701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 465/921] 10.222.0.83 () {56 vars in 1147 bytes} [Wed Dec 15 13:24:51 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:51.567555 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ffdc2-1218-4193-9a9e-3ee96d817338 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:51.578485 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ffdc2-1218-4193-9a9e-3ee96d817338 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:51.584216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d7973-05af-4f9e-b875-4cc79ee69725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:51.585392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d7973-05af-4f9e-b875-4cc79ee69725 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:51.585938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d7973-05af-4f9e-b875-4cc79ee69725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:51.586551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d7973-05af-4f9e-b875-4cc79ee69725 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:51.587505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d7973-05af-4f9e-b875-4cc79ee69725 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:51.588078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d7973-05af-4f9e-b875-4cc79ee69725 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:51.590016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d7973-05af-4f9e-b875-4cc79ee69725 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:51.597038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 457/922] 10.222.0.83 () {56 vars in 1147 bytes} [Wed Dec 15 13:24:51 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:51.604536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41248b-f41c-4d60-acea-3833a3e7e848 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:51.615949 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41248b-f41c-4d60-acea-3833a3e7e848 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:51.623351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce416afd-b486-4a82-a6e3-233461cea22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:51.624563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416afd-b486-4a82-a6e3-233461cea22e admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:51.625241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416afd-b486-4a82-a6e3-233461cea22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:51.625920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416afd-b486-4a82-a6e3-233461cea22e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:51.627753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce416afd-b486-4a82-a6e3-233461cea22e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:51.629783 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce416afd-b486-4a82-a6e3-233461cea22e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:51.659853 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 466/923] 10.222.0.83 () {60 vars in 1165 bytes} [Wed Dec 15 13:24:51 2021] POST /identity/v3/endpoints => generated 347 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:52.385100 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035bb7d-b40b-4bc1-a6db-cde42b5d1086 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:52.385625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035bb7d-b40b-4bc1-a6db-cde42b5d1086 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:52.385625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035bb7d-b40b-4bc1-a6db-cde42b5d1086 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:52.387781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 458/924] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:52.394337 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56d2d4-17fc-4347-9651-cc2f50deb345 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:52.394847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56d2d4-17fc-4347-9651-cc2f50deb345 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:52.394926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56d2d4-17fc-4347-9651-cc2f50deb345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:52.415106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2d56d2d4-17fc-4347-9651-cc2f50deb345 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:52.416314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2d56d2d4-17fc-4347-9651-cc2f50deb345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:52.442071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 467/925] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:52 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:52.466568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035bb7d-b40b-4bc1-a6db-cde42b5d1086 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:52.479450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035bb7d-b40b-4bc1-a6db-cde42b5d1086 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:52.483947 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59e3a2-1099-4d65-a4d2-0e273c5d7fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:52.484763 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59e3a2-1099-4d65-a4d2-0e273c5d7fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:52.485037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59e3a2-1099-4d65-a4d2-0e273c5d7fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:52.485310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59e3a2-1099-4d65-a4d2-0e273c5d7fc3 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:52.486021 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59e3a2-1099-4d65-a4d2-0e273c5d7fc3 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:52.487639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59e3a2-1099-4d65-a4d2-0e273c5d7fc3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:52.500717 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-2e59e3a2-1099-4d65-a4d2-0e273c5d7fc3 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 13:24:52.505900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 459/926] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:52 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:52.509968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56d2d4-17fc-4347-9651-cc2f50deb345 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:52.520097 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56d2d4-17fc-4347-9651-cc2f50deb345 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:52.525533 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f1f03-fede-4c09-b672-217072a74cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:52.526312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f1f03-fede-4c09-b672-217072a74cdd admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:52.526604 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f1f03-fede-4c09-b672-217072a74cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:52.527084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f1f03-fede-4c09-b672-217072a74cdd admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:52.527920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f1f03-fede-4c09-b672-217072a74cdd admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:52.528231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f1f03-fede-4c09-b672-217072a74cdd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:52.530512 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f1f03-fede-4c09-b672-217072a74cdd admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:52.545974 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 468/927] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:52 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:52.549195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59e3a2-1099-4d65-a4d2-0e273c5d7fc3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:52.566632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59e3a2-1099-4d65-a4d2-0e273c5d7fc3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:52.574923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4937d4-1943-4eba-9769-37db9e66c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:52.576116 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4937d4-1943-4eba-9769-37db9e66c9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:52.576648 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4937d4-1943-4eba-9769-37db9e66c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:52.577107 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4937d4-1943-4eba-9769-37db9e66c9c9 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:52.578446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4937d4-1943-4eba-9769-37db9e66c9c9 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:52.578956 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4937d4-1943-4eba-9769-37db9e66c9c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:52.581012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4937d4-1943-4eba-9769-37db9e66c9c9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:52.592530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 460/928] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:52 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:52.594181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f1f03-fede-4c09-b672-217072a74cdd admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:52.604758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f1f03-fede-4c09-b672-217072a74cdd admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:52.609925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf676e4-d22c-4aa8-bc73-a1f9664e6879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:52.610714 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf676e4-d22c-4aa8-bc73-a1f9664e6879 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:52.611002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf676e4-d22c-4aa8-bc73-a1f9664e6879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:52.611371 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf676e4-d22c-4aa8-bc73-a1f9664e6879 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:52.612668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf676e4-d22c-4aa8-bc73-a1f9664e6879 admin admin] RBAC: Adding query filter params (interface=public, service_id=839f866a38c9459c959ee702993c108a, region_id=RegionOne) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:52.613147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf676e4-d22c-4aa8-bc73-a1f9664e6879 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:52.614853 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf676e4-d22c-4aa8-bc73-a1f9664e6879 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:52.633007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 469/929] 10.222.0.83 () {56 vars in 1272 bytes} [Wed Dec 15 13:24:52 2021] GET /identity/v3/endpoints?service_id=839f866a38c9459c959ee702993c108a&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:52.633339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4937d4-1943-4eba-9769-37db9e66c9c9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:52.641467 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4937d4-1943-4eba-9769-37db9e66c9c9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:52.646546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8689d-4ec3-4921-ad7c-791bf64c36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:52.647242 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8689d-4ec3-4921-ad7c-791bf64c36eb admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:52.647600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8689d-4ec3-4921-ad7c-791bf64c36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:52.647878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8689d-4ec3-4921-ad7c-791bf64c36eb admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:52.648597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8689d-4ec3-4921-ad7c-791bf64c36eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:52.650385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8689d-4ec3-4921-ad7c-791bf64c36eb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:52.661935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 461/930] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Dec 15 13:24:52 2021] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:24:53.849855 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e00cf8-08c6-4356-9eda-b75ae970bc6b None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:53.850381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e00cf8-08c6-4356-9eda-b75ae970bc6b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:53.850874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e00cf8-08c6-4356-9eda-b75ae970bc6b None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:53.855032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 470/931] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:53 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:53.865433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66143238-9743-4e0f-acca-2e1f34ea825b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:53.866125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66143238-9743-4e0f-acca-2e1f34ea825b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:53.866496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66143238-9743-4e0f-acca-2e1f34ea825b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:53.896887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-66143238-9743-4e0f-acca-2e1f34ea825b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:53.899663 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-66143238-9743-4e0f-acca-2e1f34ea825b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:53.913473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 462/932] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:53 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:53.954964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e00cf8-08c6-4356-9eda-b75ae970bc6b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:53.976836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e00cf8-08c6-4356-9eda-b75ae970bc6b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:53.984413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0c051-00b1-462f-be10-609d48e810f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:53.985856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0c051-00b1-462f-be10-609d48e810f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:53.986346 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0c051-00b1-462f-be10-609d48e810f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:53.986819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0c051-00b1-462f-be10-609d48e810f4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.006991 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0c051-00b1-462f-be10-609d48e810f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:24:54.022449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-d7e0c051-00b1-462f-be10-609d48e810f4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:24:54.025210 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 471/933] 10.222.0.83 () {56 vars in 1141 bytes} [Wed Dec 15 13:24:53 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:54.036318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66143238-9743-4e0f-acca-2e1f34ea825b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.052429 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66143238-9743-4e0f-acca-2e1f34ea825b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.060881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0773f52-d68a-4749-ab1d-6c1bf24d6268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.062029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0773f52-d68a-4749-ab1d-6c1bf24d6268 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.062567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0773f52-d68a-4749-ab1d-6c1bf24d6268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.063037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0773f52-d68a-4749-ab1d-6c1bf24d6268 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.064462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0773f52-d68a-4749-ab1d-6c1bf24d6268 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:54.065064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0773f52-d68a-4749-ab1d-6c1bf24d6268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.067986 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0773f52-d68a-4749-ab1d-6c1bf24d6268 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.085279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 463/934] 10.222.0.83 () {56 vars in 1136 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:54.091754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0c051-00b1-462f-be10-609d48e810f4 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.102179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0c051-00b1-462f-be10-609d48e810f4 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.106744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaa0dc-3d3b-4670-8d1e-dc95e21f091a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.107536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa0dc-3d3b-4670-8d1e-dc95e21f091a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.107810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa0dc-3d3b-4670-8d1e-dc95e21f091a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.108080 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa0dc-3d3b-4670-8d1e-dc95e21f091a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.119411 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaa0dc-3d3b-4670-8d1e-dc95e21f091a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.121232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaa0dc-3d3b-4670-8d1e-dc95e21f091a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.138920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-6bfaa0dc-3d3b-4670-8d1e-dc95e21f091a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:54.145339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 472/935] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:54.146751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0773f52-d68a-4749-ab1d-6c1bf24d6268 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.156880 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0773f52-d68a-4749-ab1d-6c1bf24d6268 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.161711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455391c-782c-4108-a90f-1198091ae8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.162445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455391c-782c-4108-a90f-1198091ae8ba admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.162725 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455391c-782c-4108-a90f-1198091ae8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.162996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455391c-782c-4108-a90f-1198091ae8ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.163885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455391c-782c-4108-a90f-1198091ae8ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:54.164133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455391c-782c-4108-a90f-1198091ae8ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.165788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455391c-782c-4108-a90f-1198091ae8ba admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.182738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 464/936] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:54.185718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaa0dc-3d3b-4670-8d1e-dc95e21f091a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.196680 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaa0dc-3d3b-4670-8d1e-dc95e21f091a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.201528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c781e-4fb4-48f2-bd7b-bcecd0be2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.202390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c781e-4fb4-48f2-bd7b-bcecd0be2282 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.202715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c781e-4fb4-48f2-bd7b-bcecd0be2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.202975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c781e-4fb4-48f2-bd7b-bcecd0be2282 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.211378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c781e-4fb4-48f2-bd7b-bcecd0be2282 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.213481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c781e-4fb4-48f2-bd7b-bcecd0be2282 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.229074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-135c781e-4fb4-48f2-bd7b-bcecd0be2282 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 13:24:54.236295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 473/937] 10.222.0.83 () {56 vars in 1138 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:54.237787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455391c-782c-4108-a90f-1198091ae8ba admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.248854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455391c-782c-4108-a90f-1198091ae8ba admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.253742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3b2b6-850e-4430-88f7-40df09a5aed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.254466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3b2b6-850e-4430-88f7-40df09a5aed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.254738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3b2b6-850e-4430-88f7-40df09a5aed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.255059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3b2b6-850e-4430-88f7-40df09a5aed9 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.255925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3b2b6-850e-4430-88f7-40df09a5aed9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:54.256278 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3b2b6-850e-4430-88f7-40df09a5aed9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.258770 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3b2b6-850e-4430-88f7-40df09a5aed9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.281894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 465/938] 10.222.0.83 () {56 vars in 1170 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:54.284767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c781e-4fb4-48f2-bd7b-bcecd0be2282 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.295962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c781e-4fb4-48f2-bd7b-bcecd0be2282 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.301231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81db0-b74f-4986-a8d9-0afa899a6348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.301911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81db0-b74f-4986-a8d9-0afa899a6348 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.302236 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81db0-b74f-4986-a8d9-0afa899a6348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.302504 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81db0-b74f-4986-a8d9-0afa899a6348 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.312398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81db0-b74f-4986-a8d9-0afa899a6348 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.314236 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81db0-b74f-4986-a8d9-0afa899a6348 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.329611 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 474/939] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:24:54.331100 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3b2b6-850e-4430-88f7-40df09a5aed9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.341290 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3b2b6-850e-4430-88f7-40df09a5aed9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.346051 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b814-cfa4-408f-84d7-2c441a57dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.346895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b814-cfa4-408f-84d7-2c441a57dea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.347170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b814-cfa4-408f-84d7-2c441a57dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.347492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b814-cfa4-408f-84d7-2c441a57dea1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.358807 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74b814-cfa4-408f-84d7-2c441a57dea1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.360892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74b814-cfa4-408f-84d7-2c441a57dea1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.379575 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-dd74b814-cfa4-408f-84d7-2c441a57dea1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:24:54.385915 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 466/940] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:54.388010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81db0-b74f-4986-a8d9-0afa899a6348 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.397286 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81db0-b74f-4986-a8d9-0afa899a6348 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.402198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4620f-b1e1-46b7-8463-160c0fe96a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.402930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4620f-b1e1-46b7-8463-160c0fe96a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.403210 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4620f-b1e1-46b7-8463-160c0fe96a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.403482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4620f-b1e1-46b7-8463-160c0fe96a78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.404289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4620f-b1e1-46b7-8463-160c0fe96a78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:54.404601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4620f-b1e1-46b7-8463-160c0fe96a78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.406430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4620f-b1e1-46b7-8463-160c0fe96a78 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.424190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 475/941] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:54.426525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b814-cfa4-408f-84d7-2c441a57dea1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.437732 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b814-cfa4-408f-84d7-2c441a57dea1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.442730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf91c6-9db3-49fa-a15e-6aa74d952363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.443609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf91c6-9db3-49fa-a15e-6aa74d952363 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.443887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf91c6-9db3-49fa-a15e-6aa74d952363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.444156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf91c6-9db3-49fa-a15e-6aa74d952363 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.452412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf91c6-9db3-49fa-a15e-6aa74d952363 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.454528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf91c6-9db3-49fa-a15e-6aa74d952363 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.468727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-15cf91c6-9db3-49fa-a15e-6aa74d952363 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:54.470260 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 467/942] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:24:54.477568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4620f-b1e1-46b7-8463-160c0fe96a78 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.488519 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4620f-b1e1-46b7-8463-160c0fe96a78 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.494263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0a747-3e34-454b-8bd7-c659571c7ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.495034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0a747-3e34-454b-8bd7-c659571c7ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.495317 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0a747-3e34-454b-8bd7-c659571c7ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.495596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0a747-3e34-454b-8bd7-c659571c7ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.496541 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0a747-3e34-454b-8bd7-c659571c7ddf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:54.496915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0a747-3e34-454b-8bd7-c659571c7ddf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.499065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0a747-3e34-454b-8bd7-c659571c7ddf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.519627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 476/943] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:54.523110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf91c6-9db3-49fa-a15e-6aa74d952363 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.534735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf91c6-9db3-49fa-a15e-6aa74d952363 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.540268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fa9c5-be44-4286-9024-2f33219202bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.541005 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fa9c5-be44-4286-9024-2f33219202bb admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.541287 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fa9c5-be44-4286-9024-2f33219202bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.541559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fa9c5-be44-4286-9024-2f33219202bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.542507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fa9c5-be44-4286-9024-2f33219202bb admin admin] RBAC: Adding query filter params (role.id=8527ff64b4bd4649a23f8fb0d079d8b4, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=126a2ccd1b86445480efa0468d96960a) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:54.542813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fa9c5-be44-4286-9024-2f33219202bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.545373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b4428-b8d5-424c-9c62-37336dd46e09 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.545711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b4428-b8d5-424c-9c62-37336dd46e09 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.555502 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b4428-b8d5-424c-9c62-37336dd46e09 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.555792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fa9c5-be44-4286-9024-2f33219202bb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.556027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 477/944] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:54.557079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351dcc-8ca8-427b-b0b8-294884fe7d90 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.557079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351dcc-8ca8-427b-b0b8-294884fe7d90 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.557560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351dcc-8ca8-427b-b0b8-294884fe7d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.563564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 468/945] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/role_assignments?user.id=126a2ccd1b86445480efa0468d96960a&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=8527ff64b4bd4649a23f8fb0d079d8b4 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:54.585257 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-1d351dcc-8ca8-427b-b0b8-294884fe7d90 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:54.588149 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1d351dcc-8ca8-427b-b0b8-294884fe7d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:54.603990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 478/946] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:54 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:54.628782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fa9c5-be44-4286-9024-2f33219202bb admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.640231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fa9c5-be44-4286-9024-2f33219202bb admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.645374 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec87d4-e9c6-4253-8ce1-5ba5b47c15be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.646489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec87d4-e9c6-4253-8ce1-5ba5b47c15be admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.647072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec87d4-e9c6-4253-8ce1-5ba5b47c15be admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.647568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec87d4-e9c6-4253-8ce1-5ba5b47c15be admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.648339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec87d4-e9c6-4253-8ce1-5ba5b47c15be admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.650084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec87d4-e9c6-4253-8ce1-5ba5b47c15be admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.665796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-4eec87d4-e9c6-4253-8ce1-5ba5b47c15be admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 13:24:54.673165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 469/947] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/services/compute => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:54.674818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d351dcc-8ca8-427b-b0b8-294884fe7d90 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.686037 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d351dcc-8ca8-427b-b0b8-294884fe7d90 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.691925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bad6a-7f59-4d11-80a5-aecd83073840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.693025 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bad6a-7f59-4d11-80a5-aecd83073840 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.693519 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bad6a-7f59-4d11-80a5-aecd83073840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.693946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bad6a-7f59-4d11-80a5-aecd83073840 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.694819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bad6a-7f59-4d11-80a5-aecd83073840 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:54.695131 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bad6a-7f59-4d11-80a5-aecd83073840 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.696892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bad6a-7f59-4d11-80a5-aecd83073840 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.708853 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 479/948] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:54.710432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec87d4-e9c6-4253-8ce1-5ba5b47c15be admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:54.721546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec87d4-e9c6-4253-8ce1-5ba5b47c15be admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:54.727529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f9c8d-6020-494a-803a-45c7572ba23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:54.728265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f9c8d-6020-494a-803a-45c7572ba23c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:54.728534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f9c8d-6020-494a-803a-45c7572ba23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:54.728808 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f9c8d-6020-494a-803a-45c7572ba23c admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:54.729611 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f9c8d-6020-494a-803a-45c7572ba23c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:54.729998 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f9c8d-6020-494a-803a-45c7572ba23c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:54.731779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f9c8d-6020-494a-803a-45c7572ba23c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:54.742099 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 470/949] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:24:54 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:55.028611 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726b7d5-cda4-40be-aab8-1272f82fea87 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.029273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726b7d5-cda4-40be-aab8-1272f82fea87 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.029273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726b7d5-cda4-40be-aab8-1272f82fea87 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.031200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 480/950] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:55.037627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed205-d93a-4db5-9a23-a1914c258fcc None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.038805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed205-d93a-4db5-9a23-a1914c258fcc None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.038960 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed205-d93a-4db5-9a23-a1914c258fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.058667 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-cd0ed205-d93a-4db5-9a23-a1914c258fcc None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:55.060787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-cd0ed205-d93a-4db5-9a23-a1914c258fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:55.070512 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 471/951] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:55 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:55.102965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726b7d5-cda4-40be-aab8-1272f82fea87 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:55.120980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726b7d5-cda4-40be-aab8-1272f82fea87 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:55.127399 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0243f-ef35-4a97-8ec1-43b32518a587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:55.128786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0243f-ef35-4a97-8ec1-43b32518a587 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.129076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0243f-ef35-4a97-8ec1-43b32518a587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.129355 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0243f-ef35-4a97-8ec1-43b32518a587 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.130072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0243f-ef35-4a97-8ec1-43b32518a587 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:55.131673 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0243f-ef35-4a97-8ec1-43b32518a587 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:55.148735 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-b5f0243f-ef35-4a97-8ec1-43b32518a587 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 13:24:55.151153 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 481/952] 10.222.0.83 () {56 vars in 1147 bytes} [Wed Dec 15 13:24:55 2021] GET /identity/v3/services/object-store => generated 93 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:55.157547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed205-d93a-4db5-9a23-a1914c258fcc None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:55.166690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed205-d93a-4db5-9a23-a1914c258fcc None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:55.171521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0df04d-1b46-4c5a-99b8-6770dd0c3053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:55.172476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0df04d-1b46-4c5a-99b8-6770dd0c3053 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.172769 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0df04d-1b46-4c5a-99b8-6770dd0c3053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.173008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0df04d-1b46-4c5a-99b8-6770dd0c3053 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.174089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0df04d-1b46-4c5a-99b8-6770dd0c3053 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:55.174583 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0df04d-1b46-4c5a-99b8-6770dd0c3053 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:55.176636 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0df04d-1b46-4c5a-99b8-6770dd0c3053 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:55.183617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 472/953] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Dec 15 13:24:55 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:55.190148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0243f-ef35-4a97-8ec1-43b32518a587 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:55.201247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0243f-ef35-4a97-8ec1-43b32518a587 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:55.206018 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b862eef-35d6-411e-b226-76f2a7044a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:55.206754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b862eef-35d6-411e-b226-76f2a7044a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.207036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b862eef-35d6-411e-b226-76f2a7044a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.207303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b862eef-35d6-411e-b226-76f2a7044a7b admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.208141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b862eef-35d6-411e-b226-76f2a7044a7b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:55.208455 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b862eef-35d6-411e-b226-76f2a7044a7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:55.210849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b862eef-35d6-411e-b226-76f2a7044a7b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:55.218635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 482/954] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Dec 15 13:24:55 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:55.227368 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0df04d-1b46-4c5a-99b8-6770dd0c3053 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:55.241946 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0df04d-1b46-4c5a-99b8-6770dd0c3053 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:55.247102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122bb7f-fcd9-4d6c-94b7-da2d40b53d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:55.247768 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122bb7f-fcd9-4d6c-94b7-da2d40b53d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.248138 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122bb7f-fcd9-4d6c-94b7-da2d40b53d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.248413 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122bb7f-fcd9-4d6c-94b7-da2d40b53d89 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.249275 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122bb7f-fcd9-4d6c-94b7-da2d40b53d89 admin admin] RBAC: Adding query filter params (interface=public, service_id=f6cdfe57242b49c7a042ae2de5d4db02, region_id=RegionOne) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:55.249585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122bb7f-fcd9-4d6c-94b7-da2d40b53d89 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:55.251413 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122bb7f-fcd9-4d6c-94b7-da2d40b53d89 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:55.259606 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 473/955] 10.222.0.83 () {56 vars in 1272 bytes} [Wed Dec 15 13:24:55 2021] GET /identity/v3/endpoints?service_id=f6cdfe57242b49c7a042ae2de5d4db02&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:55.265836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b862eef-35d6-411e-b226-76f2a7044a7b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:55.276496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b862eef-35d6-411e-b226-76f2a7044a7b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:55.281295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2653546-6c0f-40b3-b204-26de847987ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:55.281936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2653546-6c0f-40b3-b204-26de847987ac admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.282217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2653546-6c0f-40b3-b204-26de847987ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.282492 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2653546-6c0f-40b3-b204-26de847987ac admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.283180 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2653546-6c0f-40b3-b204-26de847987ac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:55.284762 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2653546-6c0f-40b3-b204-26de847987ac admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:55.291574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 483/956] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Dec 15 13:24:55 2021] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:24:55.377662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d178568-96f8-499a-b9f1-db76a7443eea None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.378055 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d178568-96f8-499a-b9f1-db76a7443eea None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.378301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d178568-96f8-499a-b9f1-db76a7443eea None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.380426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 474/957] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:55.387435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cf869-8395-4751-a2af-6cfe8fe46ae3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.387866 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cf869-8395-4751-a2af-6cfe8fe46ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.388106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cf869-8395-4751-a2af-6cfe8fe46ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.407829 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-690cf869-8395-4751-a2af-6cfe8fe46ae3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:55.409044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-690cf869-8395-4751-a2af-6cfe8fe46ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:55.417459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 484/958] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:55 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:55.446542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d178568-96f8-499a-b9f1-db76a7443eea None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:55.465531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d178568-96f8-499a-b9f1-db76a7443eea None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:55.471028 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac7332-6b06-43b6-8a2e-778b6e270569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:55.471861 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7332-6b06-43b6-8a2e-778b6e270569 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.472197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7332-6b06-43b6-8a2e-778b6e270569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.472475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7332-6b06-43b6-8a2e-778b6e270569 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.473353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac7332-6b06-43b6-8a2e-778b6e270569 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:55.475104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac7332-6b06-43b6-8a2e-778b6e270569 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:55.487612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-15ac7332-6b06-43b6-8a2e-778b6e270569 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 13:24:55.489201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 475/959] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:55 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:55.496575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cf869-8395-4751-a2af-6cfe8fe46ae3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:55.506478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cf869-8395-4751-a2af-6cfe8fe46ae3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:55.512125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b138f-2071-4f22-9527-e73e39f4a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:55.512820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b138f-2071-4f22-9527-e73e39f4a9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.513104 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b138f-2071-4f22-9527-e73e39f4a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.513383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b138f-2071-4f22-9527-e73e39f4a9eb admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.514162 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b138f-2071-4f22-9527-e73e39f4a9eb admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:55.514471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b138f-2071-4f22-9527-e73e39f4a9eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:55.516187 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b138f-2071-4f22-9527-e73e39f4a9eb admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:55.522174 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 485/960] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:55 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:55.528519 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac7332-6b06-43b6-8a2e-778b6e270569 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:55.544453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac7332-6b06-43b6-8a2e-778b6e270569 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:55.549431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f5810-329b-4caa-9ae3-31c3da87ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:55.550185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5810-329b-4caa-9ae3-31c3da87ca64 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.550514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5810-329b-4caa-9ae3-31c3da87ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.550792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5810-329b-4caa-9ae3-31c3da87ca64 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.551550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f5810-329b-4caa-9ae3-31c3da87ca64 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:55.551848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f5810-329b-4caa-9ae3-31c3da87ca64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:55.553497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f5810-329b-4caa-9ae3-31c3da87ca64 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:55.561045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 476/961] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Dec 15 13:24:55 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:55.567150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b138f-2071-4f22-9527-e73e39f4a9eb admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:55.578450 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b138f-2071-4f22-9527-e73e39f4a9eb admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:55.583555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349e088-e309-4feb-9ea3-1671d4b19b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:55.584318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e088-e309-4feb-9ea3-1671d4b19b96 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:55.584641 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e088-e309-4feb-9ea3-1671d4b19b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:55.584907 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e088-e309-4feb-9ea3-1671d4b19b96 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:55.585677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349e088-e309-4feb-9ea3-1671d4b19b96 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:55.587380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349e088-e309-4feb-9ea3-1671d4b19b96 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:55.611418 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 486/962] 10.222.0.83 () {60 vars in 1165 bytes} [Wed Dec 15 13:24:55 2021] POST /identity/v3/endpoints => generated 346 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:24:57.339634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b5680-e78e-4a3e-ab38-638d7a92a16a None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:57.340631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b5680-e78e-4a3e-ab38-638d7a92a16a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:57.340631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b5680-e78e-4a3e-ab38-638d7a92a16a None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:57.342306 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 477/963] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:57.348665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f176e6-1ee2-4078-864e-2df44614f10f None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:57.349495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f176e6-1ee2-4078-864e-2df44614f10f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:57.349495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f176e6-1ee2-4078-864e-2df44614f10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:57.376166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e3f176e6-1ee2-4078-864e-2df44614f10f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:57.378115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e3f176e6-1ee2-4078-864e-2df44614f10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:57.409896 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 487/964] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:57 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:57.433529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b5680-e78e-4a3e-ab38-638d7a92a16a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:57.449408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b5680-e78e-4a3e-ab38-638d7a92a16a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:57.454736 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4fb7-956b-47f3-9c92-6dac1d617690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:57.455402 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4fb7-956b-47f3-9c92-6dac1d617690 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:57.455694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4fb7-956b-47f3-9c92-6dac1d617690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:57.455935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4fb7-956b-47f3-9c92-6dac1d617690 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:57.456666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4fb7-956b-47f3-9c92-6dac1d617690 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:57.458297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4fb7-956b-47f3-9c92-6dac1d617690 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:57.464536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6129f1f-edac-411d-b907-e0517b842a11 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:57.465052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6129f1f-edac-411d-b907-e0517b842a11 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:57.465555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6129f1f-edac-411d-b907-e0517b842a11 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:57.468993 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 488/965] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:57 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:24:57.475018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 478/966] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:24:57 2021] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:57.477124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8996e-87c6-4b4b-806f-5b8295e733c5 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:57.477554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8996e-87c6-4b4b-806f-5b8295e733c5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:57.485840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8996e-87c6-4b4b-806f-5b8295e733c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:57.502557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a0e8996e-87c6-4b4b-806f-5b8295e733c5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:57.503888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a0e8996e-87c6-4b4b-806f-5b8295e733c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:57.523657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 489/967] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:57 2021] POST /identity/v3/auth/tokens => generated 2234 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:57.552716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4fb7-956b-47f3-9c92-6dac1d617690 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:57.565817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4fb7-956b-47f3-9c92-6dac1d617690 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:57.577976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e86c1-9cfa-477c-9fd9-7ac275e0cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:57.579229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e86c1-9cfa-477c-9fd9-7ac275e0cc0b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:57.579785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e86c1-9cfa-477c-9fd9-7ac275e0cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:57.580288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e86c1-9cfa-477c-9fd9-7ac275e0cc0b admin admin] PATH_INFO: `/v3/services/image` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:57.581215 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e86c1-9cfa-477c-9fd9-7ac275e0cc0b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:57.583582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e86c1-9cfa-477c-9fd9-7ac275e0cc0b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:57.598550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-651e86c1-9cfa-477c-9fd9-7ac275e0cc0b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 13:24:57.600696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 479/968] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Dec 15 13:24:57 2021] GET /identity/v3/services/image => generated 86 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:57.608202 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8996e-87c6-4b4b-806f-5b8295e733c5 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:57.622014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8996e-87c6-4b4b-806f-5b8295e733c5 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:57.629436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76d61b-f6ac-4cf2-9cca-c428b6ea4c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:57.630237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76d61b-f6ac-4cf2-9cca-c428b6ea4c64 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:57.630654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76d61b-f6ac-4cf2-9cca-c428b6ea4c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:57.631136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76d61b-f6ac-4cf2-9cca-c428b6ea4c64 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:57.632735 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76d61b-f6ac-4cf2-9cca-c428b6ea4c64 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:57.633104 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76d61b-f6ac-4cf2-9cca-c428b6ea4c64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:57.635397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76d61b-f6ac-4cf2-9cca-c428b6ea4c64 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:57.645903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 490/969] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:57 2021] GET /identity/v3/services?name=image => generated 122 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:57.648654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e86c1-9cfa-477c-9fd9-7ac275e0cc0b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:57.664992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e86c1-9cfa-477c-9fd9-7ac275e0cc0b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:57.669916 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f00fe7-89b0-4f8a-9dfd-b5edbb710d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:57.670597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00fe7-89b0-4f8a-9dfd-b5edbb710d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:57.670888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00fe7-89b0-4f8a-9dfd-b5edbb710d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:57.671217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00fe7-89b0-4f8a-9dfd-b5edbb710d48 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:57.671967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f00fe7-89b0-4f8a-9dfd-b5edbb710d48 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:57.672268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f00fe7-89b0-4f8a-9dfd-b5edbb710d48 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:57.673946 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f00fe7-89b0-4f8a-9dfd-b5edbb710d48 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:57.680385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 480/970] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:24:57 2021] GET /identity/v3/services?type=image => generated 122 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:58.204167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98abf8c-0169-4937-a93e-c0a8a522dbb5 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:58.204675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98abf8c-0169-4937-a93e-c0a8a522dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:58.205065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98abf8c-0169-4937-a93e-c0a8a522dbb5 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:58.207289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 491/971] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:58.213668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7dbfd-e768-4cab-87eb-8f439c0eb234 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:58.214092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7dbfd-e768-4cab-87eb-8f439c0eb234 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:58.214463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7dbfd-e768-4cab-87eb-8f439c0eb234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:58.235342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-adf7dbfd-e768-4cab-87eb-8f439c0eb234 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:58.236890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-adf7dbfd-e768-4cab-87eb-8f439c0eb234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:58.247375 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 481/972] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:58 2021] POST /identity/v3/auth/tokens => generated 2234 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:24:58.272459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98abf8c-0169-4937-a93e-c0a8a522dbb5 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:58.288002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98abf8c-0169-4937-a93e-c0a8a522dbb5 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:58.293852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4815d4c-1a1f-4318-8a97-8141864f1118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:58.294663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4815d4c-1a1f-4318-8a97-8141864f1118 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:58.294940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4815d4c-1a1f-4318-8a97-8141864f1118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:58.295210 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4815d4c-1a1f-4318-8a97-8141864f1118 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:58.296100 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4815d4c-1a1f-4318-8a97-8141864f1118 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:58.298059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4815d4c-1a1f-4318-8a97-8141864f1118 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:58.313240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-b4815d4c-1a1f-4318-8a97-8141864f1118 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 13:24:58.314929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 492/973] 10.222.0.83 () {56 vars in 1147 bytes} [Wed Dec 15 13:24:58 2021] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:58.321369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7dbfd-e768-4cab-87eb-8f439c0eb234 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:58.330909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7dbfd-e768-4cab-87eb-8f439c0eb234 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:58.335587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96078ab-c147-4a70-823a-f2ab746cb547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:58.336252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96078ab-c147-4a70-823a-f2ab746cb547 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:58.336530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96078ab-c147-4a70-823a-f2ab746cb547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:58.336800 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96078ab-c147-4a70-823a-f2ab746cb547 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:58.337526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96078ab-c147-4a70-823a-f2ab746cb547 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:58.337856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96078ab-c147-4a70-823a-f2ab746cb547 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:58.339674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96078ab-c147-4a70-823a-f2ab746cb547 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:58.346288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 482/974] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Dec 15 13:24:58 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:24:58.353382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4815d4c-1a1f-4318-8a97-8141864f1118 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:58.363448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4815d4c-1a1f-4318-8a97-8141864f1118 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:58.368753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb912da-c1c4-4d5c-bf99-f1150a146ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:58.369475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb912da-c1c4-4d5c-bf99-f1150a146ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:58.369775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb912da-c1c4-4d5c-bf99-f1150a146ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:58.370056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb912da-c1c4-4d5c-bf99-f1150a146ec9 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:58.370827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb912da-c1c4-4d5c-bf99-f1150a146ec9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:58.371126 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb912da-c1c4-4d5c-bf99-f1150a146ec9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:58.372893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb912da-c1c4-4d5c-bf99-f1150a146ec9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:58.378775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 493/975] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Dec 15 13:24:58 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:24:58.385660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96078ab-c147-4a70-823a-f2ab746cb547 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:58.397288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96078ab-c147-4a70-823a-f2ab746cb547 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:58.406028 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2adf0-4df4-4c85-93dd-f87255c468c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:58.406748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2adf0-4df4-4c85-93dd-f87255c468c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:58.407185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2adf0-4df4-4c85-93dd-f87255c468c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:58.407389 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095c65-adb6-47ac-8626-8ac0c626089d None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:58.407557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2adf0-4df4-4c85-93dd-f87255c468c7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:58.407735 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095c65-adb6-47ac-8626-8ac0c626089d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:58.407951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095c65-adb6-47ac-8626-8ac0c626089d None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:58.408269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2adf0-4df4-4c85-93dd-f87255c468c7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:58.410431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2adf0-4df4-4c85-93dd-f87255c468c7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:58.410629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 494/976] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:24:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:24:58.417129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e312b-d126-4583-a202-eee6c6b898a3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:58.417414 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e312b-d126-4583-a202-eee6c6b898a3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:58.417683 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e312b-d126-4583-a202-eee6c6b898a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:58.438760 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-c37e312b-d126-4583-a202-eee6c6b898a3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:24:58.440136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c37e312b-d126-4583-a202-eee6c6b898a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:24:58.447538 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 483/977] 10.222.0.83 () {60 vars in 1165 bytes} [Wed Dec 15 13:24:58 2021] POST /identity/v3/endpoints => generated 349 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:24:58.461817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 495/978] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:24:58 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:24:58.489791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2adf0-4df4-4c85-93dd-f87255c468c7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:58.503872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2adf0-4df4-4c85-93dd-f87255c468c7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:58.509210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e8565-5533-4e56-9e52-d61fb3358d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:58.509964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e8565-5533-4e56-9e52-d61fb3358d8c admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:58.510248 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e8565-5533-4e56-9e52-d61fb3358d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:58.510524 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e8565-5533-4e56-9e52-d61fb3358d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:58.511316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e8565-5533-4e56-9e52-d61fb3358d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:58.513469 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e8565-5533-4e56-9e52-d61fb3358d8c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:58.515021 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.common [None req-453e8565-5533-4e56-9e52-d61fb3358d8c admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 15 13:24:58.540091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.sql.core [None req-453e8565-5533-4e56-9e52-d61fb3358d8c admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 15 13:24:58.540091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 15 13:24:58.540091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [parameters: {'id': '81d24deca0e944d088a27ecdbfeb8973', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 15 13:24:58.540091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79139) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 13:24:58.557284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-453e8565-5533-4e56-9e52-d61fb3358d8c admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 81d24deca0e944d088a27ecdbfeb8973.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 81d24deca0e944d088a27ecdbfeb8973. Dec 15 13:24:58.559553 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 484/979] 10.222.0.83 () {60 vars in 1161 bytes} [Wed Dec 15 13:24:58 2021] POST /identity/v3/projects => generated 262 bytes in 71 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:58.569271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e312b-d126-4583-a202-eee6c6b898a3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:58.577340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e312b-d126-4583-a202-eee6c6b898a3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:58.582663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e58bdf-b1e5-4bfd-ac00-cc665a1ce8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:58.583487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e58bdf-b1e5-4bfd-ac00-cc665a1ce8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:58.583771 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e58bdf-b1e5-4bfd-ac00-cc665a1ce8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:58.584051 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e58bdf-b1e5-4bfd-ac00-cc665a1ce8c3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:58.593434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e58bdf-b1e5-4bfd-ac00-cc665a1ce8c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:58.595792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e58bdf-b1e5-4bfd-ac00-cc665a1ce8c3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:58.614779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-a7e58bdf-b1e5-4bfd-ac00-cc665a1ce8c3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:24:58.616453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 496/980] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:24:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:24:58.623429 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e8565-5533-4e56-9e52-d61fb3358d8c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:24:58.637228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e8565-5533-4e56-9e52-d61fb3358d8c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:24:58.642534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d725b8-b7f7-40c9-86a3-1da82f2841cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:24:58.643212 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d725b8-b7f7-40c9-86a3-1da82f2841cf admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:24:58.643498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d725b8-b7f7-40c9-86a3-1da82f2841cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:24:58.643775 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d725b8-b7f7-40c9-86a3-1da82f2841cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:24:58.644601 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d725b8-b7f7-40c9-86a3-1da82f2841cf admin admin] RBAC: Adding query filter params (name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:24:58.644908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d725b8-b7f7-40c9-86a3-1da82f2841cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:24:58.647240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d725b8-b7f7-40c9-86a3-1da82f2841cf admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:24:58.674196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 485/981] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:24:58 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:00.126979 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a727c-3577-449f-ae60-6e43dddbc235 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:00.127499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a727c-3577-449f-ae60-6e43dddbc235 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:00.127573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a727c-3577-449f-ae60-6e43dddbc235 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:00.129533 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 497/982] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:00.135658 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1001-425f-4fa8-9806-41817fa4a853 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:00.136065 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1001-425f-4fa8-9806-41817fa4a853 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:00.136229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d1001-425f-4fa8-9806-41817fa4a853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:00.155021 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-1e1d1001-425f-4fa8-9806-41817fa4a853 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:00.156612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1e1d1001-425f-4fa8-9806-41817fa4a853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:00.165384 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 486/983] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:00 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:00.190265 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a727c-3577-449f-ae60-6e43dddbc235 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:00.212042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a727c-3577-449f-ae60-6e43dddbc235 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:00.218917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfde68-7df4-46e0-ab43-d1aed8809e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:00.220468 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfde68-7df4-46e0-ab43-d1aed8809e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:00.221232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfde68-7df4-46e0-ab43-d1aed8809e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:00.222025 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfde68-7df4-46e0-ab43-d1aed8809e94 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:00.223505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfde68-7df4-46e0-ab43-d1aed8809e94 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:00.227512 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfde68-7df4-46e0-ab43-d1aed8809e94 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:00.245147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-04cfde68-7df4-46e0-ab43-d1aed8809e94 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 13:25:00.247663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 498/984] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:25:00 2021] GET /identity/v3/services/compute => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:25:00.254395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d1001-425f-4fa8-9806-41817fa4a853 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:00.264497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d1001-425f-4fa8-9806-41817fa4a853 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:00.271658 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94c41-beea-44ad-9b7d-01731459886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:00.273645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94c41-beea-44ad-9b7d-01731459886d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:00.274405 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94c41-beea-44ad-9b7d-01731459886d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:00.275161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94c41-beea-44ad-9b7d-01731459886d admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:00.276598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e94c41-beea-44ad-9b7d-01731459886d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:00.277206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e94c41-beea-44ad-9b7d-01731459886d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:00.279272 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e94c41-beea-44ad-9b7d-01731459886d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:00.290907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 487/985] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:25:00 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:00.293159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90205-d75f-4574-9ac0-100edb92de47 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:00.293782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90205-d75f-4574-9ac0-100edb92de47 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:00.294288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90205-d75f-4574-9ac0-100edb92de47 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:00.297407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94c41-beea-44ad-9b7d-01731459886d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:00.300712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 499/986] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:00.302477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5cea1-2789-4c6d-9525-5cc6d8d46b9f None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:00.302669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5cea1-2789-4c6d-9525-5cc6d8d46b9f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:00.302970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5cea1-2789-4c6d-9525-5cc6d8d46b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:00.313098 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94c41-beea-44ad-9b7d-01731459886d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:00.318958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f7f6e-aa4e-402b-b0bb-7d3c0947f226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:00.320249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f7f6e-aa4e-402b-b0bb-7d3c0947f226 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:00.320708 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f7f6e-aa4e-402b-b0bb-7d3c0947f226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:00.321155 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f7f6e-aa4e-402b-b0bb-7d3c0947f226 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:00.322093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f7f6e-aa4e-402b-b0bb-7d3c0947f226 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:00.322585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f7f6e-aa4e-402b-b0bb-7d3c0947f226 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:00.324145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-24d5cea1-2789-4c6d-9525-5cc6d8d46b9f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:00.324552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f7f6e-aa4e-402b-b0bb-7d3c0947f226 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:00.326050 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-24d5cea1-2789-4c6d-9525-5cc6d8d46b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:00.331549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 488/987] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:25:00 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:00.338321 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f7f6e-aa4e-402b-b0bb-7d3c0947f226 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:00.341875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 500/988] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:00 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:00.353419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f7f6e-aa4e-402b-b0bb-7d3c0947f226 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:00.359470 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba7698-b9af-4091-a7c9-8943287ca087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:00.360685 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba7698-b9af-4091-a7c9-8943287ca087 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:00.361259 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba7698-b9af-4091-a7c9-8943287ca087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:00.361873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba7698-b9af-4091-a7c9-8943287ca087 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:00.363700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5cea1-2789-4c6d-9525-5cc6d8d46b9f None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:00.366580 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba7698-b9af-4091-a7c9-8943287ca087 admin admin] RBAC: Adding query filter params (interface=public, service_id=627bd30b7419496ca94c990eaf0976d8, region_id=RegionOne) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:00.367428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba7698-b9af-4091-a7c9-8943287ca087 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:00.370532 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba7698-b9af-4091-a7c9-8943287ca087 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:00.374167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5cea1-2789-4c6d-9525-5cc6d8d46b9f None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:00.381871 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 489/989] 10.222.0.83 () {56 vars in 1272 bytes} [Wed Dec 15 13:25:00 2021] GET /identity/v3/endpoints?service_id=627bd30b7419496ca94c990eaf0976d8&interface=public®ion_id=RegionOne => generated 194 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:00.385210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba7698-b9af-4091-a7c9-8943287ca087 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:00.386316 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6019d31-d122-4246-a3ae-752855ba322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:00.387175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6019d31-d122-4246-a3ae-752855ba322f admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:00.387602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6019d31-d122-4246-a3ae-752855ba322f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:00.388017 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6019d31-d122-4246-a3ae-752855ba322f admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:00.388898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6019d31-d122-4246-a3ae-752855ba322f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:00.390652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6019d31-d122-4246-a3ae-752855ba322f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:00.395997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba7698-b9af-4091-a7c9-8943287ca087 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:00.401495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12042eb2-28cf-460c-9e15-26631eb3b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:00.402318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12042eb2-28cf-460c-9e15-26631eb3b751 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:00.402672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12042eb2-28cf-460c-9e15-26631eb3b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:00.403022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12042eb2-28cf-460c-9e15-26631eb3b751 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:00.403810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12042eb2-28cf-460c-9e15-26631eb3b751 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:00.405558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12042eb2-28cf-460c-9e15-26631eb3b751 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:00.407730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 501/990] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:25:00 2021] POST /identity/v3/services => generated 242 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:25:00.415573 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 490/991] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Dec 15 13:25:00 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:25:01.220188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc8b92-8835-41bb-a05d-5d17fb60eb74 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.220710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc8b92-8835-41bb-a05d-5d17fb60eb74 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.220786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc8b92-8835-41bb-a05d-5d17fb60eb74 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.222846 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 502/992] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:01.229801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0baab4-2fcb-4e20-8d57-74714ba7c7f5 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.230433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0baab4-2fcb-4e20-8d57-74714ba7c7f5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.230433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0baab4-2fcb-4e20-8d57-74714ba7c7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.251604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-9b0baab4-2fcb-4e20-8d57-74714ba7c7f5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:01.253743 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e3fb-0d6d-4ec7-a416-db9ddde9691f None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.254055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e3fb-0d6d-4ec7-a416-db9ddde9691f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.254334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e3fb-0d6d-4ec7-a416-db9ddde9691f None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.256219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 503/993] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:01.257223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9b0baab4-2fcb-4e20-8d57-74714ba7c7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:01.262956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ded35-5b79-45db-a06d-2709c078098d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.262956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ded35-5b79-45db-a06d-2709c078098d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.263663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ded35-5b79-45db-a06d-2709c078098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.278517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 491/994] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:01 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:01.287446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8f4ded35-5b79-45db-a06d-2709c078098d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:01.289739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8f4ded35-5b79-45db-a06d-2709c078098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:01.301565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 504/995] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:01 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:01.311644 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0baab4-2fcb-4e20-8d57-74714ba7c7f5 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:01.326695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ded35-5b79-45db-a06d-2709c078098d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:01.329400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0baab4-2fcb-4e20-8d57-74714ba7c7f5 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:01.335083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127871a-aa8d-4f49-a227-3d74cf9b72e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:01.336247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127871a-aa8d-4f49-a227-3d74cf9b72e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.336779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127871a-aa8d-4f49-a227-3d74cf9b72e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.337258 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127871a-aa8d-4f49-a227-3d74cf9b72e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.338207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127871a-aa8d-4f49-a227-3d74cf9b72e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:01.339363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ded35-5b79-45db-a06d-2709c078098d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:01.340580 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127871a-aa8d-4f49-a227-3d74cf9b72e5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:01.345612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bf5b4-d761-4fb1-8623-10dc68576bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:01.346581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf5b4-d761-4fb1-8623-10dc68576bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.346861 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf5b4-d761-4fb1-8623-10dc68576bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.347135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf5b4-d761-4fb1-8623-10dc68576bd8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.348098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bf5b4-d761-4fb1-8623-10dc68576bd8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:01.351260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bf5b4-d761-4fb1-8623-10dc68576bd8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:01.357821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.sql.core [None req-b127871a-aa8d-4f49-a227-3d74cf9b72e5 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 15 13:25:01.357821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 15 13:25:01.357821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [parameters: {'user_id': 'b8548eb0b0044ef5af602d5352659b84', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 15 13:25:01.357821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79139) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 13:25:01.366452 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-b127871a-aa8d-4f49-a227-3d74cf9b72e5 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 15 13:25:01.368800 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 492/996] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:25:01 2021] POST /identity/v3/users => generated 160 bytes in 58 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:01.369167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-6a2bf5b4-d761-4fb1-8623-10dc68576bd8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 13:25:01.377836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 505/997] 10.222.0.83 () {56 vars in 1147 bytes} [Wed Dec 15 13:25:01 2021] GET /identity/v3/services/object-store => generated 93 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:01.377988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127871a-aa8d-4f49-a227-3d74cf9b72e5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:01.380462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bf5b4-d761-4fb1-8623-10dc68576bd8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:01.388205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127871a-aa8d-4f49-a227-3d74cf9b72e5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:01.392731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640345f-ad0e-4437-acdb-46451e2d1239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:01.393597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640345f-ad0e-4437-acdb-46451e2d1239 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.393905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640345f-ad0e-4437-acdb-46451e2d1239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.394184 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640345f-ad0e-4437-acdb-46451e2d1239 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.395523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bf5b4-d761-4fb1-8623-10dc68576bd8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:01.404889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640345f-ad0e-4437-acdb-46451e2d1239 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:01.407407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333604f7-eb8f-470f-974d-d3a017fc03cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:01.407883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640345f-ad0e-4437-acdb-46451e2d1239 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:01.408585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333604f7-eb8f-470f-974d-d3a017fc03cd admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.409087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333604f7-eb8f-470f-974d-d3a017fc03cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.409859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333604f7-eb8f-470f-974d-d3a017fc03cd admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.410911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333604f7-eb8f-470f-974d-d3a017fc03cd admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:01.411331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333604f7-eb8f-470f-974d-d3a017fc03cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:01.413086 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333604f7-eb8f-470f-974d-d3a017fc03cd admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:01.419510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 506/998] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Dec 15 13:25:01 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:01.424494 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-d640345f-ad0e-4437-acdb-46451e2d1239 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 13:25:01.425325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333604f7-eb8f-470f-974d-d3a017fc03cd admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:01.426744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 493/999] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:25:01 2021] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:01.434288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640345f-ad0e-4437-acdb-46451e2d1239 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:01.436489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333604f7-eb8f-470f-974d-d3a017fc03cd admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:01.442010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c500051-f194-4c69-9a8a-808dbffb548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:01.443536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c500051-f194-4c69-9a8a-808dbffb548a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.443835 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c500051-f194-4c69-9a8a-808dbffb548a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.444189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c500051-f194-4c69-9a8a-808dbffb548a admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.445702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c500051-f194-4c69-9a8a-808dbffb548a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:01.446146 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c500051-f194-4c69-9a8a-808dbffb548a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:01.448109 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c500051-f194-4c69-9a8a-808dbffb548a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:01.448478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640345f-ad0e-4437-acdb-46451e2d1239 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:01.453696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82dd1c-6d47-440b-ae13-a856e341fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:01.454643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82dd1c-6d47-440b-ae13-a856e341fb1b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.455141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82dd1c-6d47-440b-ae13-a856e341fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.455615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82dd1c-6d47-440b-ae13-a856e341fb1b admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.456734 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82dd1c-6d47-440b-ae13-a856e341fb1b admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:01.457274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82dd1c-6d47-440b-ae13-a856e341fb1b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:01.459729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82dd1c-6d47-440b-ae13-a856e341fb1b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:01.460612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 507/1000] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Dec 15 13:25:01 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:01.461706 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c500051-f194-4c69-9a8a-808dbffb548a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:01.474250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c500051-f194-4c69-9a8a-808dbffb548a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:01.480513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed53c8-f3dc-4195-bcc5-3e2247434c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:01.481174 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed53c8-f3dc-4195-bcc5-3e2247434c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.481449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed53c8-f3dc-4195-bcc5-3e2247434c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.481897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed53c8-f3dc-4195-bcc5-3e2247434c7d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.483105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed53c8-f3dc-4195-bcc5-3e2247434c7d admin admin] RBAC: Adding query filter params (interface=admin, service_id=f6cdfe57242b49c7a042ae2de5d4db02, region_id=RegionOne) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:01.483495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed53c8-f3dc-4195-bcc5-3e2247434c7d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:01.485257 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed53c8-f3dc-4195-bcc5-3e2247434c7d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:01.498041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 508/1001] 10.222.0.83 () {56 vars in 1270 bytes} [Wed Dec 15 13:25:01 2021] GET /identity/v3/endpoints?service_id=f6cdfe57242b49c7a042ae2de5d4db02&interface=admin®ion_id=RegionOne => generated 193 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:01.500382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed53c8-f3dc-4195-bcc5-3e2247434c7d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:01.509131 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 494/1002] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Dec 15 13:25:01 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:01.515144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed53c8-f3dc-4195-bcc5-3e2247434c7d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:01.518137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53d330-8cb5-4368-8a14-06f0bfe93fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:01.518818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53d330-8cb5-4368-8a14-06f0bfe93fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:01.519097 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53d330-8cb5-4368-8a14-06f0bfe93fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:01.519371 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53d330-8cb5-4368-8a14-06f0bfe93fd0 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:01.520071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53d330-8cb5-4368-8a14-06f0bfe93fd0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:01.521689 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53d330-8cb5-4368-8a14-06f0bfe93fd0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:01.538991 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 509/1003] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Dec 15 13:25:01 2021] GET /identity/v3/services => generated 1957 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:25:03.027727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab0af-95b7-4887-9263-c1b8049df376 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.028207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab0af-95b7-4887-9263-c1b8049df376 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.028207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab0af-95b7-4887-9263-c1b8049df376 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.030252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 495/1004] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:03.036751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027721-2e95-434a-ab77-8e32be444b8d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.037232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027721-2e95-434a-ab77-8e32be444b8d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.037317 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027721-2e95-434a-ab77-8e32be444b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.058283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-84027721-2e95-434a-ab77-8e32be444b8d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:03.066292 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-84027721-2e95-434a-ab77-8e32be444b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:03.082115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 510/1005] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:03 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:03.100577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ab0af-95b7-4887-9263-c1b8049df376 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:03.116283 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ab0af-95b7-4887-9263-c1b8049df376 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:03.120974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81be410-f1cf-4e3b-95b5-c7e3c4e4ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:03.121840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81be410-f1cf-4e3b-95b5-c7e3c4e4ad19 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.122483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81be410-f1cf-4e3b-95b5-c7e3c4e4ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.122765 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81be410-f1cf-4e3b-95b5-c7e3c4e4ad19 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.123431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81be410-f1cf-4e3b-95b5-c7e3c4e4ad19 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:03.125143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81be410-f1cf-4e3b-95b5-c7e3c4e4ad19 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:03.142410 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-e81be410-f1cf-4e3b-95b5-c7e3c4e4ad19 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 13:25:03.149671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 496/1006] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:25:03 2021] GET /identity/v3/services/compute => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:03.150850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84027721-2e95-434a-ab77-8e32be444b8d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:03.160597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84027721-2e95-434a-ab77-8e32be444b8d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:03.167121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9111884-a911-4fee-88dd-abb7a00ab571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:03.167793 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111884-a911-4fee-88dd-abb7a00ab571 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.168074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111884-a911-4fee-88dd-abb7a00ab571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.168347 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111884-a911-4fee-88dd-abb7a00ab571 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.169072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9111884-a911-4fee-88dd-abb7a00ab571 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:03.169374 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9111884-a911-4fee-88dd-abb7a00ab571 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:03.171023 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9111884-a911-4fee-88dd-abb7a00ab571 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:03.176407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 511/1007] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:25:03 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:03.182682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81be410-f1cf-4e3b-95b5-c7e3c4e4ad19 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:03.192914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81be410-f1cf-4e3b-95b5-c7e3c4e4ad19 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:03.197689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04d996-0c4f-4e25-b53c-034cb87fc781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:03.198461 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04d996-0c4f-4e25-b53c-034cb87fc781 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.198813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04d996-0c4f-4e25-b53c-034cb87fc781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.199154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04d996-0c4f-4e25-b53c-034cb87fc781 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.199940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04d996-0c4f-4e25-b53c-034cb87fc781 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:03.200309 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04d996-0c4f-4e25-b53c-034cb87fc781 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:03.201976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04d996-0c4f-4e25-b53c-034cb87fc781 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:03.207513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 497/1008] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Dec 15 13:25:03 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:03.214412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9111884-a911-4fee-88dd-abb7a00ab571 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:03.228430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9111884-a911-4fee-88dd-abb7a00ab571 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:03.233952 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cd952-eb5c-4e27-b122-f5eb827d5acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:03.234736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cd952-eb5c-4e27-b122-f5eb827d5acf admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.235021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cd952-eb5c-4e27-b122-f5eb827d5acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.235296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cd952-eb5c-4e27-b122-f5eb827d5acf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.236054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cd952-eb5c-4e27-b122-f5eb827d5acf admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:03.237623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cd952-eb5c-4e27-b122-f5eb827d5acf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:03.260758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 512/1009] 10.222.0.83 () {60 vars in 1165 bytes} [Wed Dec 15 13:25:03 2021] POST /identity/v3/endpoints => generated 334 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:25:03.304187 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6120bf-0892-406e-818c-c47352cf857e None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.304387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6120bf-0892-406e-818c-c47352cf857e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.304660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6120bf-0892-406e-818c-c47352cf857e None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.306545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 498/1010] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:03.313148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b52e2-8ffe-4b57-a51f-980b0c4be4c1 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.313559 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b52e2-8ffe-4b57-a51f-980b0c4be4c1 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.314084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b52e2-8ffe-4b57-a51f-980b0c4be4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.333632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-de8b52e2-8ffe-4b57-a51f-980b0c4be4c1 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:03.337895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-de8b52e2-8ffe-4b57-a51f-980b0c4be4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:03.360426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 513/1011] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:03 2021] POST /identity/v3/auth/tokens => generated 2675 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:03.385652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6120bf-0892-406e-818c-c47352cf857e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:03.401123 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6120bf-0892-406e-818c-c47352cf857e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:03.409939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7fe64-1e7c-450f-9f52-df264a9aa858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:03.411255 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7fe64-1e7c-450f-9f52-df264a9aa858 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.411545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7fe64-1e7c-450f-9f52-df264a9aa858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.411823 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7fe64-1e7c-450f-9f52-df264a9aa858 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.412546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7fe64-1e7c-450f-9f52-df264a9aa858 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:03.414968 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7fe64-1e7c-450f-9f52-df264a9aa858 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:03.426802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-e3e7fe64-1e7c-450f-9f52-df264a9aa858 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 13:25:03.428304 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 499/1012] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Dec 15 13:25:03 2021] GET /identity/v3/services/image => generated 86 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:03.434838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b52e2-8ffe-4b57-a51f-980b0c4be4c1 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:03.445142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b52e2-8ffe-4b57-a51f-980b0c4be4c1 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:03.449881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db3039-83ee-4ca5-ab80-3c16e1b6dbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:03.450569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db3039-83ee-4ca5-ab80-3c16e1b6dbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.450849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db3039-83ee-4ca5-ab80-3c16e1b6dbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.451121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db3039-83ee-4ca5-ab80-3c16e1b6dbe0 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.451852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db3039-83ee-4ca5-ab80-3c16e1b6dbe0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:03.452156 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db3039-83ee-4ca5-ab80-3c16e1b6dbe0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:03.453796 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db3039-83ee-4ca5-ab80-3c16e1b6dbe0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:03.459726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 514/1013] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:03 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:03.466433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7fe64-1e7c-450f-9f52-df264a9aa858 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:03.481302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7fe64-1e7c-450f-9f52-df264a9aa858 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:03.487758 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ec39-0249-4d48-a16e-82bed3333557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:03.488418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ec39-0249-4d48-a16e-82bed3333557 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.488688 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ec39-0249-4d48-a16e-82bed3333557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.488983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ec39-0249-4d48-a16e-82bed3333557 admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.489666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ec39-0249-4d48-a16e-82bed3333557 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:03.489992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ec39-0249-4d48-a16e-82bed3333557 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:03.491621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ec39-0249-4d48-a16e-82bed3333557 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:03.497276 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 500/1014] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:03 2021] GET /identity/v3/services?type=image => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:03.507634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db3039-83ee-4ca5-ab80-3c16e1b6dbe0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:03.519909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db3039-83ee-4ca5-ab80-3c16e1b6dbe0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:03.527372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2c74c-af89-476f-a503-7c4037496fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:03.528042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c74c-af89-476f-a503-7c4037496fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.528325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c74c-af89-476f-a503-7c4037496fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.528600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c74c-af89-476f-a503-7c4037496fe5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.529409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2c74c-af89-476f-a503-7c4037496fe5 admin admin] RBAC: Adding query filter params (interface=public, service_id=5343157182dc40fabe05d96b8178d488, region_id=RegionOne) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:03.529719 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2c74c-af89-476f-a503-7c4037496fe5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:03.531331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2c74c-af89-476f-a503-7c4037496fe5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:03.537969 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 515/1015] 10.222.0.83 () {56 vars in 1272 bytes} [Wed Dec 15 13:25:03 2021] GET /identity/v3/endpoints?service_id=5343157182dc40fabe05d96b8178d488&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:03.544639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ec39-0249-4d48-a16e-82bed3333557 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:03.556169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ec39-0249-4d48-a16e-82bed3333557 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:03.562525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8e90c-954c-42cb-ba78-275564874e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:03.563196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8e90c-954c-42cb-ba78-275564874e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:03.563474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8e90c-954c-42cb-ba78-275564874e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:03.563741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8e90c-954c-42cb-ba78-275564874e7b admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:03.564437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8e90c-954c-42cb-ba78-275564874e7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:03.566034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8e90c-954c-42cb-ba78-275564874e7b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:03.573499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 501/1016] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Dec 15 13:25:03 2021] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:25:04.121647 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23187ed-7dfa-49cd-ab44-50358236921c None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:04.122276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23187ed-7dfa-49cd-ab44-50358236921c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:04.122276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23187ed-7dfa-49cd-ab44-50358236921c None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:04.123996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 516/1017] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:04.130367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7863fa-3966-46a9-a4fb-d867f6f9b088 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:04.130817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7863fa-3966-46a9-a4fb-d867f6f9b088 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:04.130922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7863fa-3966-46a9-a4fb-d867f6f9b088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:04.150622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-8d7863fa-3966-46a9-a4fb-d867f6f9b088 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:04.152157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8d7863fa-3966-46a9-a4fb-d867f6f9b088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:04.160620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 502/1018] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:04 2021] POST /identity/v3/auth/tokens => generated 2675 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:04.185259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23187ed-7dfa-49cd-ab44-50358236921c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:04.197606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23187ed-7dfa-49cd-ab44-50358236921c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:04.202089 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8306c-e620-42db-998d-bb41cdc429bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:04.202946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8306c-e620-42db-998d-bb41cdc429bb admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:04.203235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8306c-e620-42db-998d-bb41cdc429bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:04.203578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8306c-e620-42db-998d-bb41cdc429bb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:04.204176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8306c-e620-42db-998d-bb41cdc429bb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:04.205745 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8306c-e620-42db-998d-bb41cdc429bb admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:04.216904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-d1e8306c-e620-42db-998d-bb41cdc429bb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 13:25:04.218273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 517/1019] 10.222.0.83 () {56 vars in 1147 bytes} [Wed Dec 15 13:25:04 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:04.224530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7863fa-3966-46a9-a4fb-d867f6f9b088 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:04.235096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7863fa-3966-46a9-a4fb-d867f6f9b088 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:04.239950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b316ae-6eeb-49eb-8f59-65d6c2b15e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:04.240742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b316ae-6eeb-49eb-8f59-65d6c2b15e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:04.241124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b316ae-6eeb-49eb-8f59-65d6c2b15e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:04.241533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b316ae-6eeb-49eb-8f59-65d6c2b15e1e admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:04.242895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b316ae-6eeb-49eb-8f59-65d6c2b15e1e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:04.243265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b316ae-6eeb-49eb-8f59-65d6c2b15e1e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:04.246958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b316ae-6eeb-49eb-8f59-65d6c2b15e1e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:04.253966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 503/1020] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Dec 15 13:25:04 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:04.260678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8306c-e620-42db-998d-bb41cdc429bb admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:04.270910 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8306c-e620-42db-998d-bb41cdc429bb admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:04.276431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346e13f-55d9-4238-a577-71b22e12075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:04.277252 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346e13f-55d9-4238-a577-71b22e12075e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:04.277669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346e13f-55d9-4238-a577-71b22e12075e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:04.278154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346e13f-55d9-4238-a577-71b22e12075e admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:04.279026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346e13f-55d9-4238-a577-71b22e12075e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:04.279479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346e13f-55d9-4238-a577-71b22e12075e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:04.281395 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346e13f-55d9-4238-a577-71b22e12075e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:04.290234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 518/1021] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Dec 15 13:25:04 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:04.297533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b316ae-6eeb-49eb-8f59-65d6c2b15e1e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:04.311710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b316ae-6eeb-49eb-8f59-65d6c2b15e1e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:04.316795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843741f1-aed9-4640-8c65-01fcb046d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:04.317449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843741f1-aed9-4640-8c65-01fcb046d0db admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:04.317714 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843741f1-aed9-4640-8c65-01fcb046d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:04.318066 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843741f1-aed9-4640-8c65-01fcb046d0db admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:04.318764 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843741f1-aed9-4640-8c65-01fcb046d0db admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:04.320337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843741f1-aed9-4640-8c65-01fcb046d0db admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:04.340115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 504/1022] 10.222.0.83 () {60 vars in 1165 bytes} [Wed Dec 15 13:25:04 2021] POST /identity/v3/endpoints => generated 325 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:25:05.959176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852cd7-c07f-4195-ba7e-5b119fadc064 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:05.959721 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852cd7-c07f-4195-ba7e-5b119fadc064 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:05.959721 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852cd7-c07f-4195-ba7e-5b119fadc064 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:05.962193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 519/1023] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:25:05.963415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5517a70-e30a-4cb3-b97f-2a94a4a28ce9 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:05.963943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5517a70-e30a-4cb3-b97f-2a94a4a28ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:05.964035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5517a70-e30a-4cb3-b97f-2a94a4a28ce9 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:05.966040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 505/1024] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:25:05.967840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f655-936e-4aee-90bf-04a1dfce3c1d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:05.968128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f655-936e-4aee-90bf-04a1dfce3c1d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:05.968407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f655-936e-4aee-90bf-04a1dfce3c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:05.971350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e97714-6f15-4ea7-8ef8-100f218b8cde None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:05.971635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e97714-6f15-4ea7-8ef8-100f218b8cde None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:05.971912 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e97714-6f15-4ea7-8ef8-100f218b8cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:05.987454 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-1cb8f655-936e-4aee-90bf-04a1dfce3c1d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:05.988663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1cb8f655-936e-4aee-90bf-04a1dfce3c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:05.993392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-96e97714-6f15-4ea7-8ef8-100f218b8cde None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:05.994697 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-96e97714-6f15-4ea7-8ef8-100f218b8cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:06.010227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 520/1025] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:05 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:06.017196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 506/1026] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:05 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:06.036844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8f655-936e-4aee-90bf-04a1dfce3c1d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.046238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8f655-936e-4aee-90bf-04a1dfce3c1d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.050004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e97714-6f15-4ea7-8ef8-100f218b8cde None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.051150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7983b2b-fb18-4703-8d35-e6d8da19b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.051993 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7983b2b-fb18-4703-8d35-e6d8da19b27d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.052258 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7983b2b-fb18-4703-8d35-e6d8da19b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.052487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7983b2b-fb18-4703-8d35-e6d8da19b27d admin admin] PATH_INFO: `/v3/services/image` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.053148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7983b2b-fb18-4703-8d35-e6d8da19b27d admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.055456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7983b2b-fb18-4703-8d35-e6d8da19b27d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.060293 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e97714-6f15-4ea7-8ef8-100f218b8cde None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.065540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9e0ce-22f3-4f86-a8e3-ed037c8c77c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.066478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9e0ce-22f3-4f86-a8e3-ed037c8c77c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.066822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9e0ce-22f3-4f86-a8e3-ed037c8c77c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.067046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-b7983b2b-fb18-4703-8d35-e6d8da19b27d admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 13:25:06.067158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9e0ce-22f3-4f86-a8e3-ed037c8c77c6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.068446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 521/1027] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:06.075218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7983b2b-fb18-4703-8d35-e6d8da19b27d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.080137 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9e0ce-22f3-4f86-a8e3-ed037c8c77c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:06.088065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7983b2b-fb18-4703-8d35-e6d8da19b27d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.088377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-96f9e0ce-22f3-4f86-a8e3-ed037c8c77c6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:25:06.090079 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 507/1028] 10.222.0.83 () {56 vars in 1141 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:06.093999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2c441-872b-44bb-8dd7-a97c50b2d5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.094653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2c441-872b-44bb-8dd7-a97c50b2d5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.094939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2c441-872b-44bb-8dd7-a97c50b2d5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.095209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2c441-872b-44bb-8dd7-a97c50b2d5c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.096045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2c441-872b-44bb-8dd7-a97c50b2d5c0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:06.096290 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2c441-872b-44bb-8dd7-a97c50b2d5c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.096539 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9e0ce-22f3-4f86-a8e3-ed037c8c77c6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.097941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2c441-872b-44bb-8dd7-a97c50b2d5c0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.108641 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 522/1029] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:06.110911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2c441-872b-44bb-8dd7-a97c50b2d5c0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.115313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9e0ce-22f3-4f86-a8e3-ed037c8c77c6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.122709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2c441-872b-44bb-8dd7-a97c50b2d5c0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.122944 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249ff82-f855-45de-b0a1-b838cbec698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.123537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249ff82-f855-45de-b0a1-b838cbec698c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.123911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249ff82-f855-45de-b0a1-b838cbec698c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.124259 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249ff82-f855-45de-b0a1-b838cbec698c admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.125138 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249ff82-f855-45de-b0a1-b838cbec698c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:06.125514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249ff82-f855-45de-b0a1-b838cbec698c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.127549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249ff82-f855-45de-b0a1-b838cbec698c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.128852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07347bd9-9cf0-4ae4-8d66-b5bf48178457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.129679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347bd9-9cf0-4ae4-8d66-b5bf48178457 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.129989 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347bd9-9cf0-4ae4-8d66-b5bf48178457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.130570 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347bd9-9cf0-4ae4-8d66-b5bf48178457 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.131251 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07347bd9-9cf0-4ae4-8d66-b5bf48178457 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:06.131634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07347bd9-9cf0-4ae4-8d66-b5bf48178457 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.134342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07347bd9-9cf0-4ae4-8d66-b5bf48178457 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.138871 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 508/1030] 10.222.0.83 () {56 vars in 1136 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:06.144053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 523/1031] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/services?type=image => generated 350 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:06.146414 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249ff82-f855-45de-b0a1-b838cbec698c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.150260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07347bd9-9cf0-4ae4-8d66-b5bf48178457 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.158819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249ff82-f855-45de-b0a1-b838cbec698c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.160350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07347bd9-9cf0-4ae4-8d66-b5bf48178457 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.165225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fc11b-4b4f-466f-b414-8229b63645a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.165376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b6b47-a620-4a52-9fb3-24cf347215c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.165984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6b47-a620-4a52-9fb3-24cf347215c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.166267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6b47-a620-4a52-9fb3-24cf347215c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.166455 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fc11b-4b4f-466f-b414-8229b63645a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.166556 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6b47-a620-4a52-9fb3-24cf347215c7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.166857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fc11b-4b4f-466f-b414-8229b63645a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.167134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fc11b-4b4f-466f-b414-8229b63645a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.167291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b6b47-a620-4a52-9fb3-24cf347215c7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.168831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b6b47-a620-4a52-9fb3-24cf347215c7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.182985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fc11b-4b4f-466f-b414-8229b63645a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.186052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fc11b-4b4f-466f-b414-8229b63645a9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.197838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 524/1032] 10.222.0.83 () {60 vars in 1165 bytes} [Wed Dec 15 13:25:06 2021] POST /identity/v3/endpoints => generated 327 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:25:06.217261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-665fc11b-4b4f-466f-b414-8229b63645a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:25:06.218895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 509/1033] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:06.225391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b6b47-a620-4a52-9fb3-24cf347215c7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.252278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b6b47-a620-4a52-9fb3-24cf347215c7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.258280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279f67e-13c6-4868-aefe-1c7a4abef413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.258976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279f67e-13c6-4868-aefe-1c7a4abef413 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.259248 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279f67e-13c6-4868-aefe-1c7a4abef413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.259518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279f67e-13c6-4868-aefe-1c7a4abef413 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.260281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279f67e-13c6-4868-aefe-1c7a4abef413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:06.260583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279f67e-13c6-4868-aefe-1c7a4abef413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.262282 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279f67e-13c6-4868-aefe-1c7a4abef413 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.275403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 525/1034] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:06.283540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fc11b-4b4f-466f-b414-8229b63645a9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.295696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fc11b-4b4f-466f-b414-8229b63645a9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.301204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6002393-f4e3-42c3-9f5c-a715ea34c739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.302041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002393-f4e3-42c3-9f5c-a715ea34c739 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.302355 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002393-f4e3-42c3-9f5c-a715ea34c739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.302618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002393-f4e3-42c3-9f5c-a715ea34c739 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.313339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6002393-f4e3-42c3-9f5c-a715ea34c739 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.316263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6002393-f4e3-42c3-9f5c-a715ea34c739 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.339915 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-d6002393-f4e3-42c3-9f5c-a715ea34c739 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:25:06.341435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 510/1035] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:25:06.347644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279f67e-13c6-4868-aefe-1c7a4abef413 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.358095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279f67e-13c6-4868-aefe-1c7a4abef413 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.362970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995441a-6065-48c5-a4e0-a2179b8b8cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.363666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995441a-6065-48c5-a4e0-a2179b8b8cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.363952 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995441a-6065-48c5-a4e0-a2179b8b8cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.364220 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995441a-6065-48c5-a4e0-a2179b8b8cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.365081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995441a-6065-48c5-a4e0-a2179b8b8cf6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:06.365387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995441a-6065-48c5-a4e0-a2179b8b8cf6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.367815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995441a-6065-48c5-a4e0-a2179b8b8cf6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.395674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 526/1036] 10.222.0.83 () {56 vars in 1154 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:06.398065 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6002393-f4e3-42c3-9f5c-a715ea34c739 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.415159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6002393-f4e3-42c3-9f5c-a715ea34c739 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.424773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60342d95-2079-4b42-a923-8146c59e37fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.425892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60342d95-2079-4b42-a923-8146c59e37fd admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.426377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60342d95-2079-4b42-a923-8146c59e37fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.427046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60342d95-2079-4b42-a923-8146c59e37fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.439250 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60342d95-2079-4b42-a923-8146c59e37fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.441059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60342d95-2079-4b42-a923-8146c59e37fd admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.454467 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 511/1037] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:06.461628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995441a-6065-48c5-a4e0-a2179b8b8cf6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.474115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995441a-6065-48c5-a4e0-a2179b8b8cf6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.479829 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abff35-1ff8-4adf-aa28-79534b9a6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.480724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abff35-1ff8-4adf-aa28-79534b9a6a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.480993 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abff35-1ff8-4adf-aa28-79534b9a6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.481273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abff35-1ff8-4adf-aa28-79534b9a6a97 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.502241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abff35-1ff8-4adf-aa28-79534b9a6a97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.505082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abff35-1ff8-4adf-aa28-79534b9a6a97 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.525369 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-29abff35-1ff8-4adf-aa28-79534b9a6a97 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:25:06.526909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 527/1038] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:06.533434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60342d95-2079-4b42-a923-8146c59e37fd admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.552030 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60342d95-2079-4b42-a923-8146c59e37fd admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.557018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117ca96-de56-4153-a63d-e023c1a70e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.557905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117ca96-de56-4153-a63d-e023c1a70e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.558183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117ca96-de56-4153-a63d-e023c1a70e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.558627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117ca96-de56-4153-a63d-e023c1a70e04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.559478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117ca96-de56-4153-a63d-e023c1a70e04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:06.559848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117ca96-de56-4153-a63d-e023c1a70e04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.561883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117ca96-de56-4153-a63d-e023c1a70e04 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.577022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 512/1039] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:06.584423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abff35-1ff8-4adf-aa28-79534b9a6a97 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.597578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abff35-1ff8-4adf-aa28-79534b9a6a97 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.603065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361dcad-3ce3-48ed-b9c7-5aeafd94afb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.603924 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361dcad-3ce3-48ed-b9c7-5aeafd94afb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.604186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361dcad-3ce3-48ed-b9c7-5aeafd94afb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.604461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361dcad-3ce3-48ed-b9c7-5aeafd94afb6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.614864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361dcad-3ce3-48ed-b9c7-5aeafd94afb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.616868 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361dcad-3ce3-48ed-b9c7-5aeafd94afb6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.636791 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-2361dcad-3ce3-48ed-b9c7-5aeafd94afb6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:25:06.638263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 528/1040] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:06.644485 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117ca96-de56-4153-a63d-e023c1a70e04 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.663489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117ca96-de56-4153-a63d-e023c1a70e04 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.669298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fba0f-bc71-4077-93b0-3af26f4a43d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.669989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fba0f-bc71-4077-93b0-3af26f4a43d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.670265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fba0f-bc71-4077-93b0-3af26f4a43d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.670532 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fba0f-bc71-4077-93b0-3af26f4a43d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.671329 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fba0f-bc71-4077-93b0-3af26f4a43d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:06.671628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fba0f-bc71-4077-93b0-3af26f4a43d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.673439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fba0f-bc71-4077-93b0-3af26f4a43d0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.686621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 513/1041] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:06.692813 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361dcad-3ce3-48ed-b9c7-5aeafd94afb6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:06.704716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361dcad-3ce3-48ed-b9c7-5aeafd94afb6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:06.709650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54493a0f-7407-4807-9023-bae9f232d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:06.710940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54493a0f-7407-4807-9023-bae9f232d23a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.711269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54493a0f-7407-4807-9023-bae9f232d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.711516 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54493a0f-7407-4807-9023-bae9f232d23a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.712506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54493a0f-7407-4807-9023-bae9f232d23a admin admin] RBAC: Adding query filter params (role.id=8527ff64b4bd4649a23f8fb0d079d8b4, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=a34b3d2f67b1477598acce389819c70a) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:06.712814 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54493a0f-7407-4807-9023-bae9f232d23a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:06.714665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54493a0f-7407-4807-9023-bae9f232d23a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:06.721341 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 529/1042] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:25:06 2021] GET /identity/v3/role_assignments?user.id=a34b3d2f67b1477598acce389819c70a&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=8527ff64b4bd4649a23f8fb0d079d8b4 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:06.940822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552f4bd-5666-420d-86ef-622ede0bfd14 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.941095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552f4bd-5666-420d-86ef-622ede0bfd14 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.941371 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552f4bd-5666-420d-86ef-622ede0bfd14 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.943249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 514/1043] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:06.950019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e9c9-5f1e-474a-be35-07456267667d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:06.950243 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e9c9-5f1e-474a-be35-07456267667d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:06.950484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e9c9-5f1e-474a-be35-07456267667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:06.969942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-dd95e9c9-5f1e-474a-be35-07456267667d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:06.971145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-dd95e9c9-5f1e-474a-be35-07456267667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:06.979095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 530/1044] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:07.004075 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552f4bd-5666-420d-86ef-622ede0bfd14 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:07.022468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552f4bd-5666-420d-86ef-622ede0bfd14 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:07.026853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18845fa-1328-413b-af12-1ac78026f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:07.027648 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18845fa-1328-413b-af12-1ac78026f106 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:07.027932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18845fa-1328-413b-af12-1ac78026f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:07.028206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18845fa-1328-413b-af12-1ac78026f106 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:07.029389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18845fa-1328-413b-af12-1ac78026f106 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:07.031226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18845fa-1328-413b-af12-1ac78026f106 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:07.033002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 515/1045] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:07.039249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95e9c9-5f1e-474a-be35-07456267667d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:07.048325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95e9c9-5f1e-474a-be35-07456267667d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:07.052863 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a97670-90ce-429e-ad6d-afeef483dc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:07.053519 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a97670-90ce-429e-ad6d-afeef483dc0d admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:07.053827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a97670-90ce-429e-ad6d-afeef483dc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:07.054595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a97670-90ce-429e-ad6d-afeef483dc0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:07.055333 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a97670-90ce-429e-ad6d-afeef483dc0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:07.056345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-25a97670-90ce-429e-ad6d-afeef483dc0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:25:07.056345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:25:07.056345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:25:07.057522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a97670-90ce-429e-ad6d-afeef483dc0d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:07.090876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 531/1046] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:25:07 2021] POST /identity/v3/projects => generated 311 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:25:08.609119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b04d-e63f-459c-be7d-4cbdb764b26f None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:08.609678 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b04d-e63f-459c-be7d-4cbdb764b26f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:08.609678 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b04d-e63f-459c-be7d-4cbdb764b26f None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:08.611599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 516/1047] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:08.617238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca36387-41d9-4285-9bfb-a89c86ed2fb7 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:08.617673 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca36387-41d9-4285-9bfb-a89c86ed2fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:08.617883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca36387-41d9-4285-9bfb-a89c86ed2fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:08.637621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-4ca36387-41d9-4285-9bfb-a89c86ed2fb7 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:08.638660 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4ca36387-41d9-4285-9bfb-a89c86ed2fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:08.707955 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 532/1048] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:08.735767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2b04d-e63f-459c-be7d-4cbdb764b26f None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:08.748524 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2b04d-e63f-459c-be7d-4cbdb764b26f None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:08.752907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46a303-5bd0-413a-a3a0-c27be7737322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:08.753541 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46a303-5bd0-413a-a3a0-c27be7737322 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:08.753845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46a303-5bd0-413a-a3a0-c27be7737322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:08.754115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46a303-5bd0-413a-a3a0-c27be7737322 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:08.763414 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46a303-5bd0-413a-a3a0-c27be7737322 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:08.765155 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46a303-5bd0-413a-a3a0-c27be7737322 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:08.775953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 517/1049] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:08 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:08.782635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca36387-41d9-4285-9bfb-a89c86ed2fb7 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:08.792288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca36387-41d9-4285-9bfb-a89c86ed2fb7 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:08.797382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d700d9c-beab-41c3-858f-8cce3dae3b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:08.798250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d700d9c-beab-41c3-858f-8cce3dae3b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:08.798521 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d700d9c-beab-41c3-858f-8cce3dae3b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:08.798788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d700d9c-beab-41c3-858f-8cce3dae3b18 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:08.800053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d700d9c-beab-41c3-858f-8cce3dae3b18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:08.801774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d700d9c-beab-41c3-858f-8cce3dae3b18 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:08.803582 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 533/1050] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:09.204604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bec6a3-3386-41e7-a051-6474ebda1d7f None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.205046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bec6a3-3386-41e7-a051-6474ebda1d7f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.205436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bec6a3-3386-41e7-a051-6474ebda1d7f None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.208277 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 518/1051] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:09.215638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687210d-481c-4ea5-89c7-1b842cbc2ee6 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.215921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687210d-481c-4ea5-89c7-1b842cbc2ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.216196 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687210d-481c-4ea5-89c7-1b842cbc2ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.233871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-9687210d-481c-4ea5-89c7-1b842cbc2ee6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:09.235064 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9687210d-481c-4ea5-89c7-1b842cbc2ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:09.244464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 534/1052] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:09.269394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bec6a3-3386-41e7-a051-6474ebda1d7f None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.284134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bec6a3-3386-41e7-a051-6474ebda1d7f None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.293079 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaba59d-1da9-494e-95f6-d9179fb82716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.294076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaba59d-1da9-494e-95f6-d9179fb82716 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.294449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaba59d-1da9-494e-95f6-d9179fb82716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.294852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaba59d-1da9-494e-95f6-d9179fb82716 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.309188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaba59d-1da9-494e-95f6-d9179fb82716 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:09.316803 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-eaaba59d-1da9-494e-95f6-d9179fb82716 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:25:09.318027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 519/1053] 10.222.0.83 () {56 vars in 1141 bytes} [Wed Dec 15 13:25:09 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:09.325378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687210d-481c-4ea5-89c7-1b842cbc2ee6 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.334956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687210d-481c-4ea5-89c7-1b842cbc2ee6 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.343276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bb3bd-9e7e-45f4-8a52-bbc1d252ee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.343942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb3bd-9e7e-45f4-8a52-bbc1d252ee69 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.344224 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb3bd-9e7e-45f4-8a52-bbc1d252ee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.344497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb3bd-9e7e-45f4-8a52-bbc1d252ee69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.345269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bb3bd-9e7e-45f4-8a52-bbc1d252ee69 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:09.345571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bb3bd-9e7e-45f4-8a52-bbc1d252ee69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.347195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bb3bd-9e7e-45f4-8a52-bbc1d252ee69 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.355779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 535/1054] 10.222.0.83 () {56 vars in 1136 bytes} [Wed Dec 15 13:25:09 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:09.362450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaba59d-1da9-494e-95f6-d9179fb82716 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.375936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaba59d-1da9-494e-95f6-d9179fb82716 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.381664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d59e61-b42c-48ec-8a8c-4290fca8f00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.383257 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59e61-b42c-48ec-8a8c-4290fca8f00f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.383534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59e61-b42c-48ec-8a8c-4290fca8f00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.383821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59e61-b42c-48ec-8a8c-4290fca8f00f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.397082 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d59e61-b42c-48ec-8a8c-4290fca8f00f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.399412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d59e61-b42c-48ec-8a8c-4290fca8f00f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.419355 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-f2d59e61-b42c-48ec-8a8c-4290fca8f00f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:25:09.420732 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 520/1055] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:09.427085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bb3bd-9e7e-45f4-8a52-bbc1d252ee69 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.437816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bb3bd-9e7e-45f4-8a52-bbc1d252ee69 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.442513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b92cc-1bce-42cb-b94e-d3d9011b2028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.443168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b92cc-1bce-42cb-b94e-d3d9011b2028 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.443445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b92cc-1bce-42cb-b94e-d3d9011b2028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.443715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b92cc-1bce-42cb-b94e-d3d9011b2028 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.444489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b92cc-1bce-42cb-b94e-d3d9011b2028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:09.444905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b92cc-1bce-42cb-b94e-d3d9011b2028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.446547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b92cc-1bce-42cb-b94e-d3d9011b2028 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.458633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 536/1056] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:25:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:09.464794 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d59e61-b42c-48ec-8a8c-4290fca8f00f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.475513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d59e61-b42c-48ec-8a8c-4290fca8f00f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.481359 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472bc5d-0c19-46fc-8d3b-8c34f2e24509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.482183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472bc5d-0c19-46fc-8d3b-8c34f2e24509 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.482459 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472bc5d-0c19-46fc-8d3b-8c34f2e24509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.482729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472bc5d-0c19-46fc-8d3b-8c34f2e24509 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.490368 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472bc5d-0c19-46fc-8d3b-8c34f2e24509 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.492946 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472bc5d-0c19-46fc-8d3b-8c34f2e24509 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.506814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-0472bc5d-0c19-46fc-8d3b-8c34f2e24509 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:25:09.508100 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 521/1057] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Dec 15 13:25:09 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:09.514548 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b92cc-1bce-42cb-b94e-d3d9011b2028 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.525110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941ab8-9b0c-4d4a-bfb5-aed6336f6fda None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.525308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b92cc-1bce-42cb-b94e-d3d9011b2028 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.525528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941ab8-9b0c-4d4a-bfb5-aed6336f6fda None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.525969 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941ab8-9b0c-4d4a-bfb5-aed6336f6fda None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.528736 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 522/1058] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:09.529910 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde3f52-6289-4c41-8483-fc1fe8572d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.530580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde3f52-6289-4c41-8483-fc1fe8572d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.530860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde3f52-6289-4c41-8483-fc1fe8572d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.531143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde3f52-6289-4c41-8483-fc1fe8572d26 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.531990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde3f52-6289-4c41-8483-fc1fe8572d26 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:09.532294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde3f52-6289-4c41-8483-fc1fe8572d26 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.534289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde3f52-6289-4c41-8483-fc1fe8572d26 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.534437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b85775-94b9-4385-b67f-ae81a04c337f None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.534643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b85775-94b9-4385-b67f-ae81a04c337f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.534919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b85775-94b9-4385-b67f-ae81a04c337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.553234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-12b85775-94b9-4385-b67f-ae81a04c337f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:09.553452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 537/1059] 10.222.0.83 () {56 vars in 1154 bytes} [Wed Dec 15 13:25:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:09.554825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-12b85775-94b9-4385-b67f-ae81a04c337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:09.560386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde3f52-6289-4c41-8483-fc1fe8572d26 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.563856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 523/1060] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:09.571145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde3f52-6289-4c41-8483-fc1fe8572d26 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.576894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7de2c1-aef4-46a3-aab0-de919573559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.577946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7de2c1-aef4-46a3-aab0-de919573559f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.578094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7de2c1-aef4-46a3-aab0-de919573559f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.578371 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7de2c1-aef4-46a3-aab0-de919573559f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.589357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7de2c1-aef4-46a3-aab0-de919573559f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.589868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b85775-94b9-4385-b67f-ae81a04c337f None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.591242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7de2c1-aef4-46a3-aab0-de919573559f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.599890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b85775-94b9-4385-b67f-ae81a04c337f None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.605716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251f2c7-9654-4163-a050-74a9ab9ee92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.606604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251f2c7-9654-4163-a050-74a9ab9ee92c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.606938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251f2c7-9654-4163-a050-74a9ab9ee92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.607269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251f2c7-9654-4163-a050-74a9ab9ee92c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.608540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251f2c7-9654-4163-a050-74a9ab9ee92c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.609072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-8c7de2c1-aef4-46a3-aab0-de919573559f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:25:09.610359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 538/1061] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:25:09.615893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251f2c7-9654-4163-a050-74a9ab9ee92c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.615893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 524/1062] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:09.617360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7de2c1-aef4-46a3-aab0-de919573559f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.622020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251f2c7-9654-4163-a050-74a9ab9ee92c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.628471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7de2c1-aef4-46a3-aab0-de919573559f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.631781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251f2c7-9654-4163-a050-74a9ab9ee92c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.633244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedecab3-8dc7-487b-8ed9-2bd04a2573aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.633941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedecab3-8dc7-487b-8ed9-2bd04a2573aa admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.634223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedecab3-8dc7-487b-8ed9-2bd04a2573aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.634500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedecab3-8dc7-487b-8ed9-2bd04a2573aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.635228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedecab3-8dc7-487b-8ed9-2bd04a2573aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:09.635557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedecab3-8dc7-487b-8ed9-2bd04a2573aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.636742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929735-2830-457e-a1e0-44c055af6e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.637156 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedecab3-8dc7-487b-8ed9-2bd04a2573aa admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.637454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929735-2830-457e-a1e0-44c055af6e84 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.637741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929735-2830-457e-a1e0-44c055af6e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.638038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929735-2830-457e-a1e0-44c055af6e84 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.638762 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53929735-2830-457e-a1e0-44c055af6e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.640640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53929735-2830-457e-a1e0-44c055af6e84 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.648934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 539/1063] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:25:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:09.655956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedecab3-8dc7-487b-8ed9-2bd04a2573aa admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.663023 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 525/1064] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:25:09 2021] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:25:09.675128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedecab3-8dc7-487b-8ed9-2bd04a2573aa admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.681415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505972ef-bb1e-4dd2-8c16-1bce65190fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.682377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505972ef-bb1e-4dd2-8c16-1bce65190fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.682564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505972ef-bb1e-4dd2-8c16-1bce65190fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.682836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505972ef-bb1e-4dd2-8c16-1bce65190fd5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.691238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505972ef-bb1e-4dd2-8c16-1bce65190fd5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.693244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505972ef-bb1e-4dd2-8c16-1bce65190fd5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.708142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-505972ef-bb1e-4dd2-8c16-1bce65190fd5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:25:09.709463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 540/1065] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:25:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:09.716056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929735-2830-457e-a1e0-44c055af6e84 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.727978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929735-2830-457e-a1e0-44c055af6e84 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.733054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a02b22-ef38-4121-b550-b44e6f7a61f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.733793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02b22-ef38-4121-b550-b44e6f7a61f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.734107 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02b22-ef38-4121-b550-b44e6f7a61f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.734381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02b22-ef38-4121-b550-b44e6f7a61f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.735197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a02b22-ef38-4121-b550-b44e6f7a61f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:09.735506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a02b22-ef38-4121-b550-b44e6f7a61f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.737393 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a02b22-ef38-4121-b550-b44e6f7a61f7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.754418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 526/1066] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:25:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:09.761402 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505972ef-bb1e-4dd2-8c16-1bce65190fd5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:09.771879 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505972ef-bb1e-4dd2-8c16-1bce65190fd5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:09.777643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff6114-fb4a-4406-86e5-d08a3c66f1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:09.778873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff6114-fb4a-4406-86e5-d08a3c66f1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:09.778992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff6114-fb4a-4406-86e5-d08a3c66f1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:09.779288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff6114-fb4a-4406-86e5-d08a3c66f1bf admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/a34b3d2f67b1477598acce389819c70a/roles/8527ff64b4bd4649a23f8fb0d079d8b4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:09.781791 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff6114-fb4a-4406-86e5-d08a3c66f1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=a34b3d2f67b1477598acce389819c70a, role_id=8527ff64b4bd4649a23f8fb0d079d8b4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:09.784521 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff6114-fb4a-4406-86e5-d08a3c66f1bf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:09.805568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 541/1067] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:25:09 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/a34b3d2f67b1477598acce389819c70a/roles/8527ff64b4bd4649a23f8fb0d079d8b4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:25:12.131018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea09f-5306-43ef-99e0-4bdb6035d659 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.131550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea09f-5306-43ef-99e0-4bdb6035d659 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.131550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea09f-5306-43ef-99e0-4bdb6035d659 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.133354 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 527/1068] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:12.139937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f446e-daae-4679-b526-65ccba7fade9 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.140394 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f446e-daae-4679-b526-65ccba7fade9 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.140500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f446e-daae-4679-b526-65ccba7fade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.152458 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d893c2-8820-4284-ae95-1047b89897ec None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.152742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d893c2-8820-4284-ae95-1047b89897ec None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.153018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d893c2-8820-4284-ae95-1047b89897ec None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.154819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 528/1069] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:25:12.159269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-956f446e-daae-4679-b526-65ccba7fade9 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:12.160324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9f31c-70cd-4b8e-9648-4b7b41c34f4b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.160463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-956f446e-daae-4679-b526-65ccba7fade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:12.160935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9f31c-70cd-4b8e-9648-4b7b41c34f4b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.161615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9f31c-70cd-4b8e-9648-4b7b41c34f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.182893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-1ff9f31c-70cd-4b8e-9648-4b7b41c34f4b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:12.184101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1ff9f31c-70cd-4b8e-9648-4b7b41c34f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:12.231046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 542/1070] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:12.249128 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 529/1071] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:12.258520 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f446e-daae-4679-b526-65ccba7fade9 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.267908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f446e-daae-4679-b526-65ccba7fade9 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.272608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a55083-cc25-4c2e-8923-f0dfbfeb4127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.273444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55083-cc25-4c2e-8923-f0dfbfeb4127 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.273723 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55083-cc25-4c2e-8923-f0dfbfeb4127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.274135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55083-cc25-4c2e-8923-f0dfbfeb4127 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.274347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9f31c-70cd-4b8e-9648-4b7b41c34f4b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.284967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a55083-cc25-4c2e-8923-f0dfbfeb4127 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:12.285180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9f31c-70cd-4b8e-9648-4b7b41c34f4b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.290325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037bea1-b99f-4158-a802-2e28623ec5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.291158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037bea1-b99f-4158-a802-2e28623ec5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.291431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037bea1-b99f-4158-a802-2e28623ec5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.291696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037bea1-b99f-4158-a802-2e28623ec5c7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.291980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-f6a55083-cc25-4c2e-8923-f0dfbfeb4127 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:25:12.293263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 543/1072] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:12.299886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a55083-cc25-4c2e-8923-f0dfbfeb4127 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.303738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037bea1-b99f-4158-a802-2e28623ec5c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:12.310643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a55083-cc25-4c2e-8923-f0dfbfeb4127 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.311865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-3037bea1-b99f-4158-a802-2e28623ec5c7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 13:25:12.313158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 530/1073] 10.222.0.83 () {56 vars in 1141 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:25:12.315643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e899962-1203-4c16-b9d1-3c4b9fa992c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.316298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e899962-1203-4c16-b9d1-3c4b9fa992c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.316581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e899962-1203-4c16-b9d1-3c4b9fa992c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.316857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e899962-1203-4c16-b9d1-3c4b9fa992c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.317617 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e899962-1203-4c16-b9d1-3c4b9fa992c3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:12.317956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e899962-1203-4c16-b9d1-3c4b9fa992c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.319537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e899962-1203-4c16-b9d1-3c4b9fa992c3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.320446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037bea1-b99f-4158-a802-2e28623ec5c7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.328767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 544/1074] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:12.330457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037bea1-b99f-4158-a802-2e28623ec5c7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.335403 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42c811-2028-4f9a-b8e7-0c5b70cbc44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.335606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e899962-1203-4c16-b9d1-3c4b9fa992c3 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.336094 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42c811-2028-4f9a-b8e7-0c5b70cbc44e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.336370 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42c811-2028-4f9a-b8e7-0c5b70cbc44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.336637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42c811-2028-4f9a-b8e7-0c5b70cbc44e admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.337411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42c811-2028-4f9a-b8e7-0c5b70cbc44e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:12.337710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42c811-2028-4f9a-b8e7-0c5b70cbc44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.339355 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42c811-2028-4f9a-b8e7-0c5b70cbc44e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.345708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e899962-1203-4c16-b9d1-3c4b9fa992c3 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.347980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 531/1075] 10.222.0.83 () {56 vars in 1136 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:12.350738 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f0e6f-f867-4188-a8ec-9b7d7d7a9f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.351642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f0e6f-f867-4188-a8ec-9b7d7d7a9f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.351923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f0e6f-f867-4188-a8ec-9b7d7d7a9f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.352203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f0e6f-f867-4188-a8ec-9b7d7d7a9f09 admin admin] PATH_INFO: `/v3/users/04506aa3336c4a40b432090062bc5b66` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.354161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42c811-2028-4f9a-b8e7-0c5b70cbc44e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.364918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42c811-2028-4f9a-b8e7-0c5b70cbc44e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.367475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f0e6f-f867-4188-a8ec-9b7d7d7a9f09 admin admin] RBAC: Authorizing `identity:get_user(user_id=04506aa3336c4a40b432090062bc5b66)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.369686 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f0e6f-f867-4188-a8ec-9b7d7d7a9f09 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.370105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246381ac-f5cd-4331-9634-58500daf5009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.370890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246381ac-f5cd-4331-9634-58500daf5009 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.371172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246381ac-f5cd-4331-9634-58500daf5009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.371646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 545/1076] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/users/04506aa3336c4a40b432090062bc5b66 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:12.371793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246381ac-f5cd-4331-9634-58500daf5009 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.377646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f0e6f-f867-4188-a8ec-9b7d7d7a9f09 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.383930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246381ac-f5cd-4331-9634-58500daf5009 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.385683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246381ac-f5cd-4331-9634-58500daf5009 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.395671 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f0e6f-f867-4188-a8ec-9b7d7d7a9f09 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.401279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef756166-f9c8-4eff-98ac-87cf9e9477a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.401279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef756166-f9c8-4eff-98ac-87cf9e9477a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.401625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef756166-f9c8-4eff-98ac-87cf9e9477a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.401787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef756166-f9c8-4eff-98ac-87cf9e9477a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.404368 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-246381ac-f5cd-4331-9634-58500daf5009 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:25:12.405565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 532/1077] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:25:12.410140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef756166-f9c8-4eff-98ac-87cf9e9477a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.411959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246381ac-f5cd-4331-9634-58500daf5009 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.412940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef756166-f9c8-4eff-98ac-87cf9e9477a8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.421682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 546/1078] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:25:12.422850 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246381ac-f5cd-4331-9634-58500daf5009 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.427909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835dad3-31c8-4f7f-8dff-367b5566d691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.428047 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef756166-f9c8-4eff-98ac-87cf9e9477a8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.428562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835dad3-31c8-4f7f-8dff-367b5566d691 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.428841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835dad3-31c8-4f7f-8dff-367b5566d691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.429178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835dad3-31c8-4f7f-8dff-367b5566d691 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.430445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835dad3-31c8-4f7f-8dff-367b5566d691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:12.430742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835dad3-31c8-4f7f-8dff-367b5566d691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.432322 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835dad3-31c8-4f7f-8dff-367b5566d691 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.438081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef756166-f9c8-4eff-98ac-87cf9e9477a8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.443011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46d484-b810-409e-90bf-da62439e544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.443860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46d484-b810-409e-90bf-da62439e544b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.444138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46d484-b810-409e-90bf-da62439e544b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.444285 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 533/1079] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:12.444419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46d484-b810-409e-90bf-da62439e544b admin admin] PATH_INFO: `/v3/projects/636b7fb257994dcead9044c148b93428` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.445723 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46d484-b810-409e-90bf-da62439e544b admin admin] RBAC: Authorizing `identity:get_project(project_id=636b7fb257994dcead9044c148b93428)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.447775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46d484-b810-409e-90bf-da62439e544b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.449712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 547/1080] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/projects/636b7fb257994dcead9044c148b93428 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:12.453202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835dad3-31c8-4f7f-8dff-367b5566d691 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.455732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46d484-b810-409e-90bf-da62439e544b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.462990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835dad3-31c8-4f7f-8dff-367b5566d691 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.467479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0389a89-6440-46a8-87b3-603d43d1dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.468253 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0389a89-6440-46a8-87b3-603d43d1dec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.468534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0389a89-6440-46a8-87b3-603d43d1dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.468747 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46d484-b810-409e-90bf-da62439e544b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.468851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0389a89-6440-46a8-87b3-603d43d1dec6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.474158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b0079-ee3c-4dc5-8fec-92249bf434e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.474792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b0079-ee3c-4dc5-8fec-92249bf434e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.475073 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b0079-ee3c-4dc5-8fec-92249bf434e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.475534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b0079-ee3c-4dc5-8fec-92249bf434e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.477634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b0079-ee3c-4dc5-8fec-92249bf434e5 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=636b7fb257994dcead9044c148b93428, user.id=04506aa3336c4a40b432090062bc5b66) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:12.479356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0389a89-6440-46a8-87b3-603d43d1dec6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.480148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b0079-ee3c-4dc5-8fec-92249bf434e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.480585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0389a89-6440-46a8-87b3-603d43d1dec6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.480744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b0079-ee3c-4dc5-8fec-92249bf434e5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.485425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 548/1081] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/role_assignments?user.id=04506aa3336c4a40b432090062bc5b66&scope.project.id=636b7fb257994dcead9044c148b93428&role.id=a312b345efeb490eb4234d1ace386dec => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:12.494735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-f0389a89-6440-46a8-87b3-603d43d1dec6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 13:25:12.496201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 534/1082] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:12.502970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b0079-ee3c-4dc5-8fec-92249bf434e5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.513304 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b0079-ee3c-4dc5-8fec-92249bf434e5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.518386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1325e9e-a552-452d-a92f-f79fb4f38e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.519181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1325e9e-a552-452d-a92f-f79fb4f38e85 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.519556 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1325e9e-a552-452d-a92f-f79fb4f38e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.519897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1325e9e-a552-452d-a92f-f79fb4f38e85 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.520836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1325e9e-a552-452d-a92f-f79fb4f38e85 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:12.521214 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1325e9e-a552-452d-a92f-f79fb4f38e85 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.523214 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1325e9e-a552-452d-a92f-f79fb4f38e85 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.544923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 549/1083] 10.222.0.83 () {56 vars in 1154 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:12.552208 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0389a89-6440-46a8-87b3-603d43d1dec6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.565419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0389a89-6440-46a8-87b3-603d43d1dec6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.570274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba40304-0b5b-44eb-bc2a-13600a718408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.570923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba40304-0b5b-44eb-bc2a-13600a718408 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.571210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba40304-0b5b-44eb-bc2a-13600a718408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.571487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba40304-0b5b-44eb-bc2a-13600a718408 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.580599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba40304-0b5b-44eb-bc2a-13600a718408 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.582453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba40304-0b5b-44eb-bc2a-13600a718408 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.592649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 535/1084] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:12.599677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1325e9e-a552-452d-a92f-f79fb4f38e85 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.612416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1325e9e-a552-452d-a92f-f79fb4f38e85 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.618159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593141b-4e86-4338-a59a-359723e25fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.619025 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593141b-4e86-4338-a59a-359723e25fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.619304 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593141b-4e86-4338-a59a-359723e25fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.619575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593141b-4e86-4338-a59a-359723e25fc7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.631495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593141b-4e86-4338-a59a-359723e25fc7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.633516 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593141b-4e86-4338-a59a-359723e25fc7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.656956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-d593141b-4e86-4338-a59a-359723e25fc7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:25:12.658396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 550/1085] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:12.665316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba40304-0b5b-44eb-bc2a-13600a718408 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.674931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba40304-0b5b-44eb-bc2a-13600a718408 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.680270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4fdd3-cfbc-42d4-b6fb-430a598869ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.680943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4fdd3-cfbc-42d4-b6fb-430a598869ea admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.681224 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4fdd3-cfbc-42d4-b6fb-430a598869ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.681496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4fdd3-cfbc-42d4-b6fb-430a598869ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.682280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4fdd3-cfbc-42d4-b6fb-430a598869ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:12.682587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4fdd3-cfbc-42d4-b6fb-430a598869ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.684187 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4fdd3-cfbc-42d4-b6fb-430a598869ea admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.698872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 536/1086] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:12.707090 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593141b-4e86-4338-a59a-359723e25fc7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.717407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593141b-4e86-4338-a59a-359723e25fc7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.722292 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4007-e44f-4a03-8ac9-a3380ad2c6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.723197 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4007-e44f-4a03-8ac9-a3380ad2c6ca admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.723588 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4007-e44f-4a03-8ac9-a3380ad2c6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.723982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4007-e44f-4a03-8ac9-a3380ad2c6ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.731724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e4007-e44f-4a03-8ac9-a3380ad2c6ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.733710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e4007-e44f-4a03-8ac9-a3380ad2c6ca admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.747634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-bf7e4007-e44f-4a03-8ac9-a3380ad2c6ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:25:12.748826 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 551/1087] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:12.755239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4fdd3-cfbc-42d4-b6fb-430a598869ea admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.765225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4fdd3-cfbc-42d4-b6fb-430a598869ea admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.770920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5b3d0-8ec0-4648-b4da-9e37e49b4d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.771566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b3d0-8ec0-4648-b4da-9e37e49b4d8a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.771843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b3d0-8ec0-4648-b4da-9e37e49b4d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.772112 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b3d0-8ec0-4648-b4da-9e37e49b4d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.773628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5b3d0-8ec0-4648-b4da-9e37e49b4d8a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:12.773628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5b3d0-8ec0-4648-b4da-9e37e49b4d8a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.773628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5b3d0-8ec0-4648-b4da-9e37e49b4d8a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.788381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 537/1088] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:12.795832 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4007-e44f-4a03-8ac9-a3380ad2c6ca admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:12.806269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4007-e44f-4a03-8ac9-a3380ad2c6ca admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:12.810682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e6e92-af76-4fe6-b76a-f87fbc85e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:12.811563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6e92-af76-4fe6-b76a-f87fbc85e9da admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:12.811838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6e92-af76-4fe6-b76a-f87fbc85e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:12.812107 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6e92-af76-4fe6-b76a-f87fbc85e9da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:12.812933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e6e92-af76-4fe6-b76a-f87fbc85e9da admin admin] RBAC: Adding query filter params (role.id=8527ff64b4bd4649a23f8fb0d079d8b4, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=a34b3d2f67b1477598acce389819c70a) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:12.813247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e6e92-af76-4fe6-b76a-f87fbc85e9da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:12.815098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e6e92-af76-4fe6-b76a-f87fbc85e9da admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:12.822994 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 552/1089] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:25:12 2021] GET /identity/v3/role_assignments?user.id=a34b3d2f67b1477598acce389819c70a&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=8527ff64b4bd4649a23f8fb0d079d8b4 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:14.867406 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9efa64-6730-44be-881f-1a4446e67468 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:14.867935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9efa64-6730-44be-881f-1a4446e67468 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:14.867935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9efa64-6730-44be-881f-1a4446e67468 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:14.869719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 538/1090] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:14.877749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296042-e77b-4c09-bac1-4fdad4807015 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:14.878229 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296042-e77b-4c09-bac1-4fdad4807015 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:14.878229 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296042-e77b-4c09-bac1-4fdad4807015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:14.896254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-74296042-e77b-4c09-bac1-4fdad4807015 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:14.897436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-74296042-e77b-4c09-bac1-4fdad4807015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:14.906362 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 553/1091] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:14.930547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9efa64-6730-44be-881f-1a4446e67468 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:14.943072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9efa64-6730-44be-881f-1a4446e67468 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:14.948012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564a441-4441-4f01-bf91-3f4e338fbaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:14.948801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564a441-4441-4f01-bf91-3f4e338fbaaf admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:14.949077 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564a441-4441-4f01-bf91-3f4e338fbaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:14.949345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564a441-4441-4f01-bf91-3f4e338fbaaf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:14.959787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564a441-4441-4f01-bf91-3f4e338fbaaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:14.967508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-6564a441-4441-4f01-bf91-3f4e338fbaaf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:25:14.968734 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 539/1092] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:25:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:14.975726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74296042-e77b-4c09-bac1-4fdad4807015 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:14.984915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74296042-e77b-4c09-bac1-4fdad4807015 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:14.989431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc160de1-ccf1-41e9-b366-19f60197b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:14.990127 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc160de1-ccf1-41e9-b366-19f60197b1df admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:14.990408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc160de1-ccf1-41e9-b366-19f60197b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:14.990681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc160de1-ccf1-41e9-b366-19f60197b1df admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:14.991452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc160de1-ccf1-41e9-b366-19f60197b1df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:14.992261 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc160de1-ccf1-41e9-b366-19f60197b1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:14.993864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc160de1-ccf1-41e9-b366-19f60197b1df admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:15.002383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 554/1093] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:25:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:15.009530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564a441-4441-4f01-bf91-3f4e338fbaaf admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:15.021223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564a441-4441-4f01-bf91-3f4e338fbaaf admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:15.026097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83bba-d794-4089-b3fa-0cfbae7aadc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:15.026967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83bba-d794-4089-b3fa-0cfbae7aadc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:15.027243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83bba-d794-4089-b3fa-0cfbae7aadc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:15.027514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83bba-d794-4089-b3fa-0cfbae7aadc4 admin admin] PATH_INFO: `/v3/users/04506aa3336c4a40b432090062bc5b66` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:15.028737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b83bba-d794-4089-b3fa-0cfbae7aadc4 admin admin] RBAC: Authorizing `identity:get_user(user_id=04506aa3336c4a40b432090062bc5b66)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:15.030903 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b83bba-d794-4089-b3fa-0cfbae7aadc4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:15.032483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 540/1094] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:15 2021] GET /identity/v3/users/04506aa3336c4a40b432090062bc5b66 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:15.039032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc160de1-ccf1-41e9-b366-19f60197b1df admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:15.048884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc160de1-ccf1-41e9-b366-19f60197b1df admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:15.053479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35e521-db81-489d-af82-cac35462dc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:15.054876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35e521-db81-489d-af82-cac35462dc73 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:15.055150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35e521-db81-489d-af82-cac35462dc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:15.055419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35e521-db81-489d-af82-cac35462dc73 admin admin] PATH_INFO: `/v3/projects/636b7fb257994dcead9044c148b93428` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:15.056610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35e521-db81-489d-af82-cac35462dc73 admin admin] RBAC: Authorizing `identity:get_project(project_id=636b7fb257994dcead9044c148b93428)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:15.058678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35e521-db81-489d-af82-cac35462dc73 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:15.060318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 555/1095] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:15 2021] GET /identity/v3/projects/636b7fb257994dcead9044c148b93428 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:15.067620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83bba-d794-4089-b3fa-0cfbae7aadc4 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:15.078144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83bba-d794-4089-b3fa-0cfbae7aadc4 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:15.082981 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cda83-6486-49f7-ab51-30d95a6c0200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:15.083962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cda83-6486-49f7-ab51-30d95a6c0200 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:15.084320 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cda83-6486-49f7-ab51-30d95a6c0200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:15.084676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cda83-6486-49f7-ab51-30d95a6c0200 admin admin] PATH_INFO: `/v3/projects/636b7fb257994dcead9044c148b93428/users/04506aa3336c4a40b432090062bc5b66/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:15.086907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cda83-6486-49f7-ab51-30d95a6c0200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636b7fb257994dcead9044c148b93428, user_id=04506aa3336c4a40b432090062bc5b66, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:15.089613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cda83-6486-49f7-ab51-30d95a6c0200 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:15.103235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 541/1096] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:25:15 2021] PUT /identity/v3/projects/636b7fb257994dcead9044c148b93428/users/04506aa3336c4a40b432090062bc5b66/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:25:17.503007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649a8f8-14b8-4316-930d-c7043a674aaa None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:17.503554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649a8f8-14b8-4316-930d-c7043a674aaa None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:17.503646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649a8f8-14b8-4316-930d-c7043a674aaa None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:17.505917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 556/1097] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:25:17.512998 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1910208-9697-4507-9626-deb44c068cb4 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:17.513465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1910208-9697-4507-9626-deb44c068cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:17.513573 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1910208-9697-4507-9626-deb44c068cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:17.531109 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f1910208-9697-4507-9626-deb44c068cb4 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:17.532288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f1910208-9697-4507-9626-deb44c068cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:17.589390 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 542/1098] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:17 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:17.614089 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649a8f8-14b8-4316-930d-c7043a674aaa None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:17.627596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649a8f8-14b8-4316-930d-c7043a674aaa None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:17.635446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746ec2-7836-4d21-9d76-8aad32a78c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:17.636434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746ec2-7836-4d21-9d76-8aad32a78c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:17.636806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746ec2-7836-4d21-9d76-8aad32a78c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:17.637088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746ec2-7836-4d21-9d76-8aad32a78c16 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:17.650344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2746ec2-7836-4d21-9d76-8aad32a78c16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:17.659066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-e2746ec2-7836-4d21-9d76-8aad32a78c16 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:25:17.660565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 557/1099] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:25:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:25:17.668380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1910208-9697-4507-9626-deb44c068cb4 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:17.677517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1910208-9697-4507-9626-deb44c068cb4 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:17.683207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5d2cd-aa75-4f31-9c41-b9d14e783940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:17.683962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5d2cd-aa75-4f31-9c41-b9d14e783940 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:17.684336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5d2cd-aa75-4f31-9c41-b9d14e783940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:17.684704 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5d2cd-aa75-4f31-9c41-b9d14e783940 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:17.685551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5d2cd-aa75-4f31-9c41-b9d14e783940 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:17.685986 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5d2cd-aa75-4f31-9c41-b9d14e783940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:17.687911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5d2cd-aa75-4f31-9c41-b9d14e783940 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:17.699757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 543/1100] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:25:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:17.706772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746ec2-7836-4d21-9d76-8aad32a78c16 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:17.718616 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746ec2-7836-4d21-9d76-8aad32a78c16 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:17.723462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7307445-65a5-4f2a-abe4-0aae5711f38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:17.724340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7307445-65a5-4f2a-abe4-0aae5711f38f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:17.724618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7307445-65a5-4f2a-abe4-0aae5711f38f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:17.724892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7307445-65a5-4f2a-abe4-0aae5711f38f admin admin] PATH_INFO: `/v3/users/04506aa3336c4a40b432090062bc5b66` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:17.726636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7307445-65a5-4f2a-abe4-0aae5711f38f admin admin] RBAC: Authorizing `identity:get_user(user_id=04506aa3336c4a40b432090062bc5b66)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:17.728742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7307445-65a5-4f2a-abe4-0aae5711f38f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:17.730379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 558/1101] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:17 2021] GET /identity/v3/users/04506aa3336c4a40b432090062bc5b66 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:17.737200 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5d2cd-aa75-4f31-9c41-b9d14e783940 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:17.751609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5d2cd-aa75-4f31-9c41-b9d14e783940 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:17.756884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc03d3a-e797-4aea-8fcf-3a76c2ce0f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:17.757476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03d3a-e797-4aea-8fcf-3a76c2ce0f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:17.757778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03d3a-e797-4aea-8fcf-3a76c2ce0f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:17.758059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03d3a-e797-4aea-8fcf-3a76c2ce0f31 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:17.766637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc03d3a-e797-4aea-8fcf-3a76c2ce0f31 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:17.768447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc03d3a-e797-4aea-8fcf-3a76c2ce0f31 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:17.778451 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 544/1102] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:17 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:25:17.785457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7307445-65a5-4f2a-abe4-0aae5711f38f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:17.796124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7307445-65a5-4f2a-abe4-0aae5711f38f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:17.800917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a92ec-4767-47fd-8bbd-3420fc9a21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:17.801784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a92ec-4767-47fd-8bbd-3420fc9a21b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:17.802061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a92ec-4767-47fd-8bbd-3420fc9a21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:17.802338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a92ec-4767-47fd-8bbd-3420fc9a21b6 admin admin] PATH_INFO: `/v3/projects/636b7fb257994dcead9044c148b93428` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:17.803612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a92ec-4767-47fd-8bbd-3420fc9a21b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=636b7fb257994dcead9044c148b93428)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:17.806224 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a92ec-4767-47fd-8bbd-3420fc9a21b6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:17.807920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 559/1103] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:17 2021] GET /identity/v3/projects/636b7fb257994dcead9044c148b93428 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:17.815671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc03d3a-e797-4aea-8fcf-3a76c2ce0f31 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:17.827706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc03d3a-e797-4aea-8fcf-3a76c2ce0f31 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:17.832271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa7d43-9939-4833-a1a5-a82bbdec6802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:17.832913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7d43-9939-4833-a1a5-a82bbdec6802 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:17.833189 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7d43-9939-4833-a1a5-a82bbdec6802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:17.833456 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7d43-9939-4833-a1a5-a82bbdec6802 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:17.834324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa7d43-9939-4833-a1a5-a82bbdec6802 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=636b7fb257994dcead9044c148b93428, user.id=04506aa3336c4a40b432090062bc5b66) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:17.834626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa7d43-9939-4833-a1a5-a82bbdec6802 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:17.836476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa7d43-9939-4833-a1a5-a82bbdec6802 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:17.842625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 545/1104] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:25:17 2021] GET /identity/v3/role_assignments?user.id=04506aa3336c4a40b432090062bc5b66&scope.project.id=636b7fb257994dcead9044c148b93428&role.id=a312b345efeb490eb4234d1ace386dec => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:20.291002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1a333-5b9f-418c-8b31-5d4c6075d0db None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:20.298652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1a333-5b9f-418c-8b31-5d4c6075d0db None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:20.298652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1a333-5b9f-418c-8b31-5d4c6075d0db None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:20.298652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 560/1105] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:20.305715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ca1a-8583-4370-932a-fecf1d17832a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:20.306241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ca1a-8583-4370-932a-fecf1d17832a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:20.306752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ca1a-8583-4370-932a-fecf1d17832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:20.333542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f5c3ca1a-8583-4370-932a-fecf1d17832a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:20.334788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f5c3ca1a-8583-4370-932a-fecf1d17832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:20.342754 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 546/1106] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:20.369233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1a333-5b9f-418c-8b31-5d4c6075d0db None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:20.385702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1a333-5b9f-418c-8b31-5d4c6075d0db None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:20.390369 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662a796-b9f3-4b7d-82e4-51ea4d399391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:20.391148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a796-b9f3-4b7d-82e4-51ea4d399391 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:20.391420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a796-b9f3-4b7d-82e4-51ea4d399391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:20.391684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a796-b9f3-4b7d-82e4-51ea4d399391 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:20.392869 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662a796-b9f3-4b7d-82e4-51ea4d399391 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:20.394567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662a796-b9f3-4b7d-82e4-51ea4d399391 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:20.396139 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 561/1107] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:20.402543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ca1a-8583-4370-932a-fecf1d17832a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:20.411543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ca1a-8583-4370-932a-fecf1d17832a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:20.416041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1135f-95de-4d17-9d80-c5ac872a32a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:20.416727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1135f-95de-4d17-9d80-c5ac872a32a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:20.417017 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1135f-95de-4d17-9d80-c5ac872a32a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:20.417285 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1135f-95de-4d17-9d80-c5ac872a32a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:20.418040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1135f-95de-4d17-9d80-c5ac872a32a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:20.419932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1135f-95de-4d17-9d80-c5ac872a32a2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:20.442127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 547/1108] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:25:20 2021] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:25:22.855935 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc830-4765-4e70-9f10-6d266cd07879 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:22.856469 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc830-4765-4e70-9f10-6d266cd07879 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:22.856469 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc830-4765-4e70-9f10-6d266cd07879 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:22.858254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 562/1109] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:22.864073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faae74-33a4-4520-b5a0-aa2a96b02bb0 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:22.864522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faae74-33a4-4520-b5a0-aa2a96b02bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:22.864625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faae74-33a4-4520-b5a0-aa2a96b02bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:22.881911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-75faae74-33a4-4520-b5a0-aa2a96b02bb0 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:22.883622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-75faae74-33a4-4520-b5a0-aa2a96b02bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:22.891263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 548/1110] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:22.916497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc830-4765-4e70-9f10-6d266cd07879 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:22.928393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc830-4765-4e70-9f10-6d266cd07879 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:22.932709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c9c99-0f43-4ebe-87fe-44f467169e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:22.933540 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c9c99-0f43-4ebe-87fe-44f467169e39 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:22.933843 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c9c99-0f43-4ebe-87fe-44f467169e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:22.934115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c9c99-0f43-4ebe-87fe-44f467169e39 admin admin] PATH_INFO: `/v3/roles/78ec5da190bd41768cafe7cade4d3d69` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:22.935569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c9c99-0f43-4ebe-87fe-44f467169e39 admin admin] RBAC: Authorizing `identity:get_role(role_id=78ec5da190bd41768cafe7cade4d3d69)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:22.936811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-136c9c99-0f43-4ebe-87fe-44f467169e39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:25:22.936811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:25:22.936811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:25:22.937670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c9c99-0f43-4ebe-87fe-44f467169e39 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:22.939012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 563/1111] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:22 2021] GET /identity/v3/roles/78ec5da190bd41768cafe7cade4d3d69 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:22.945994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faae74-33a4-4520-b5a0-aa2a96b02bb0 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:22.954826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faae74-33a4-4520-b5a0-aa2a96b02bb0 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:22.959294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64caa-71b6-4f3a-b13c-9ff7ca4d9e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:22.960144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64caa-71b6-4f3a-b13c-9ff7ca4d9e78 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:22.960423 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64caa-71b6-4f3a-b13c-9ff7ca4d9e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:22.961229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64caa-71b6-4f3a-b13c-9ff7ca4d9e78 admin admin] PATH_INFO: `/v3/users/80deca3f967741ef9e5a51aeb02494f8` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:22.974341 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d64caa-71b6-4f3a-b13c-9ff7ca4d9e78 admin admin] RBAC: Authorizing `identity:get_user(user_id=80deca3f967741ef9e5a51aeb02494f8)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:22.976436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d64caa-71b6-4f3a-b13c-9ff7ca4d9e78 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:22.978073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 549/1112] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:22 2021] GET /identity/v3/users/80deca3f967741ef9e5a51aeb02494f8 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:22.984724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c9c99-0f43-4ebe-87fe-44f467169e39 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:22.994378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c9c99-0f43-4ebe-87fe-44f467169e39 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:22.998804 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e38ec-82b4-49d9-8f4e-ee77a68f0207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:22.999423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e38ec-82b4-49d9-8f4e-ee77a68f0207 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:22.999699 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e38ec-82b4-49d9-8f4e-ee77a68f0207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:22.999969 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e38ec-82b4-49d9-8f4e-ee77a68f0207 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:23.008108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e38ec-82b4-49d9-8f4e-ee77a68f0207 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:23.009854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e38ec-82b4-49d9-8f4e-ee77a68f0207 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:23.018399 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 564/1113] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:22 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:23.025252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64caa-71b6-4f3a-b13c-9ff7ca4d9e78 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:23.034965 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64caa-71b6-4f3a-b13c-9ff7ca4d9e78 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:23.039584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df0cd6-4a97-4e41-9665-1d04a19bab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:23.040443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df0cd6-4a97-4e41-9665-1d04a19bab1a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:23.040724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df0cd6-4a97-4e41-9665-1d04a19bab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:23.040998 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df0cd6-4a97-4e41-9665-1d04a19bab1a admin admin] PATH_INFO: `/v3/projects/636b7fb257994dcead9044c148b93428` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:23.042210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df0cd6-4a97-4e41-9665-1d04a19bab1a admin admin] RBAC: Authorizing `identity:get_project(project_id=636b7fb257994dcead9044c148b93428)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:23.044248 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df0cd6-4a97-4e41-9665-1d04a19bab1a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:23.045919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 550/1114] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:23 2021] GET /identity/v3/projects/636b7fb257994dcead9044c148b93428 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:23.052716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e38ec-82b4-49d9-8f4e-ee77a68f0207 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:23.061912 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e38ec-82b4-49d9-8f4e-ee77a68f0207 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:23.066538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e065e08-2acb-457c-9a1d-9733856a08db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:23.067173 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e065e08-2acb-457c-9a1d-9733856a08db admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:23.067453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e065e08-2acb-457c-9a1d-9733856a08db admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:23.067726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e065e08-2acb-457c-9a1d-9733856a08db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:23.068559 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e065e08-2acb-457c-9a1d-9733856a08db admin admin] RBAC: Adding query filter params (role.id=78ec5da190bd41768cafe7cade4d3d69, scope.project.id=636b7fb257994dcead9044c148b93428, user.id=80deca3f967741ef9e5a51aeb02494f8) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:23.068867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e065e08-2acb-457c-9a1d-9733856a08db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:23.071225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e065e08-2acb-457c-9a1d-9733856a08db admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:23.076442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 565/1115] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:25:23 2021] GET /identity/v3/role_assignments?user.id=80deca3f967741ef9e5a51aeb02494f8&scope.project.id=636b7fb257994dcead9044c148b93428&role.id=78ec5da190bd41768cafe7cade4d3d69 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:25.377921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f337835-00a0-4f35-8d30-9830dc8ec7d7 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:25.378476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f337835-00a0-4f35-8d30-9830dc8ec7d7 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:25.378476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f337835-00a0-4f35-8d30-9830dc8ec7d7 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:25.380230 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 551/1116] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:25:25.386088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264aadfb-94e8-4e44-92ec-7c1b4bcb7c00 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:25.386496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264aadfb-94e8-4e44-92ec-7c1b4bcb7c00 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:25.386636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264aadfb-94e8-4e44-92ec-7c1b4bcb7c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:25.403794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-264aadfb-94e8-4e44-92ec-7c1b4bcb7c00 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:25.404959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-264aadfb-94e8-4e44-92ec-7c1b4bcb7c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:25.412494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 566/1117] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:25 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:25.437787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f337835-00a0-4f35-8d30-9830dc8ec7d7 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:25.450193 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f337835-00a0-4f35-8d30-9830dc8ec7d7 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:25.454513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d22c4-3d9f-4b27-8b7e-47bd41373de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:25.455447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d22c4-3d9f-4b27-8b7e-47bd41373de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:25.455723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d22c4-3d9f-4b27-8b7e-47bd41373de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:25.455992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d22c4-3d9f-4b27-8b7e-47bd41373de3 admin admin] PATH_INFO: `/v3/roles/78ec5da190bd41768cafe7cade4d3d69` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:25.457457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d22c4-3d9f-4b27-8b7e-47bd41373de3 admin admin] RBAC: Authorizing `identity:get_role(role_id=78ec5da190bd41768cafe7cade4d3d69)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:25.458550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-9c1d22c4-3d9f-4b27-8b7e-47bd41373de3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:25:25.458550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:25:25.458550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:25:25.459404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d22c4-3d9f-4b27-8b7e-47bd41373de3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:25.461302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 552/1118] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:25 2021] GET /identity/v3/roles/78ec5da190bd41768cafe7cade4d3d69 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:25.467471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264aadfb-94e8-4e44-92ec-7c1b4bcb7c00 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:25.476397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264aadfb-94e8-4e44-92ec-7c1b4bcb7c00 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:25.480842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2b9bf-6404-49e4-a7e1-60b7fb2277b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:25.481699 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2b9bf-6404-49e4-a7e1-60b7fb2277b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:25.482008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2b9bf-6404-49e4-a7e1-60b7fb2277b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:25.482387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2b9bf-6404-49e4-a7e1-60b7fb2277b7 admin admin] PATH_INFO: `/v3/users/80deca3f967741ef9e5a51aeb02494f8` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:25.483615 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2b9bf-6404-49e4-a7e1-60b7fb2277b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=80deca3f967741ef9e5a51aeb02494f8)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:25.485748 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2b9bf-6404-49e4-a7e1-60b7fb2277b7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:25.487364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 567/1119] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:25 2021] GET /identity/v3/users/80deca3f967741ef9e5a51aeb02494f8 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:25.494281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d22c4-3d9f-4b27-8b7e-47bd41373de3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:25.503792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d22c4-3d9f-4b27-8b7e-47bd41373de3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:25.508919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf320c2-27e1-444e-84d7-671afb8a716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:25.509750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf320c2-27e1-444e-84d7-671afb8a716c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:25.510048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf320c2-27e1-444e-84d7-671afb8a716c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:25.510318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf320c2-27e1-444e-84d7-671afb8a716c admin admin] PATH_INFO: `/v3/projects/636b7fb257994dcead9044c148b93428` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:25.511481 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf320c2-27e1-444e-84d7-671afb8a716c admin admin] RBAC: Authorizing `identity:get_project(project_id=636b7fb257994dcead9044c148b93428)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:25.513484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf320c2-27e1-444e-84d7-671afb8a716c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:25.515233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 553/1120] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:25 2021] GET /identity/v3/projects/636b7fb257994dcead9044c148b93428 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:25.521497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2b9bf-6404-49e4-a7e1-60b7fb2277b7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:25.531187 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2b9bf-6404-49e4-a7e1-60b7fb2277b7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:25.536040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b2afa-872d-4495-a16c-2217953c5dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:25.536912 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b2afa-872d-4495-a16c-2217953c5dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:25.537194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b2afa-872d-4495-a16c-2217953c5dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:25.537471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b2afa-872d-4495-a16c-2217953c5dd2 admin admin] PATH_INFO: `/v3/projects/636b7fb257994dcead9044c148b93428/users/80deca3f967741ef9e5a51aeb02494f8/roles/78ec5da190bd41768cafe7cade4d3d69` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:25.539754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b2afa-872d-4495-a16c-2217953c5dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636b7fb257994dcead9044c148b93428, user_id=80deca3f967741ef9e5a51aeb02494f8, role_id=78ec5da190bd41768cafe7cade4d3d69)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:25.542398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b2afa-872d-4495-a16c-2217953c5dd2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:25.556738 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 568/1121] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:25:25 2021] PUT /identity/v3/projects/636b7fb257994dcead9044c148b93428/users/80deca3f967741ef9e5a51aeb02494f8/roles/78ec5da190bd41768cafe7cade4d3d69 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:25:27.880935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdab6e9-6bd9-443b-a644-3deedb924ddc None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:27.881489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdab6e9-6bd9-443b-a644-3deedb924ddc None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:27.881489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdab6e9-6bd9-443b-a644-3deedb924ddc None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:27.883323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 554/1122] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:27.889084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa08f19-9f45-4081-bc53-da8a8ffb2a1a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:27.889510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa08f19-9f45-4081-bc53-da8a8ffb2a1a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:27.889634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa08f19-9f45-4081-bc53-da8a8ffb2a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:27.907481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-baa08f19-9f45-4081-bc53-da8a8ffb2a1a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:27.908595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-baa08f19-9f45-4081-bc53-da8a8ffb2a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:27.963836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 569/1123] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:27.989136 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdab6e9-6bd9-443b-a644-3deedb924ddc None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:28.000994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdab6e9-6bd9-443b-a644-3deedb924ddc None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:28.005229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fe49d-904b-4744-85ea-937d1590b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:28.006096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fe49d-904b-4744-85ea-937d1590b558 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:28.006374 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fe49d-904b-4744-85ea-937d1590b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:28.006642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fe49d-904b-4744-85ea-937d1590b558 admin admin] PATH_INFO: `/v3/roles/78ec5da190bd41768cafe7cade4d3d69` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:28.008091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fe49d-904b-4744-85ea-937d1590b558 admin admin] RBAC: Authorizing `identity:get_role(role_id=78ec5da190bd41768cafe7cade4d3d69)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:28.009653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fe49d-904b-4744-85ea-937d1590b558 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:28.010971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 555/1124] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:27 2021] GET /identity/v3/roles/78ec5da190bd41768cafe7cade4d3d69 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:28.017238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa08f19-9f45-4081-bc53-da8a8ffb2a1a None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:28.026608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa08f19-9f45-4081-bc53-da8a8ffb2a1a None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:28.031135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1eeacf-e128-49fb-a30d-e518de1d0186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:28.032014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1eeacf-e128-49fb-a30d-e518de1d0186 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:28.032347 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1eeacf-e128-49fb-a30d-e518de1d0186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:28.032620 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1eeacf-e128-49fb-a30d-e518de1d0186 admin admin] PATH_INFO: `/v3/users/80deca3f967741ef9e5a51aeb02494f8` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:28.033854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1eeacf-e128-49fb-a30d-e518de1d0186 admin admin] RBAC: Authorizing `identity:get_user(user_id=80deca3f967741ef9e5a51aeb02494f8)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:28.035945 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1eeacf-e128-49fb-a30d-e518de1d0186 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:28.037500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 570/1125] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:28 2021] GET /identity/v3/users/80deca3f967741ef9e5a51aeb02494f8 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:28.044009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fe49d-904b-4744-85ea-937d1590b558 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:28.053281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fe49d-904b-4744-85ea-937d1590b558 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:28.057694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a154a01-3903-4293-ac7d-de8db22c0119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:28.058334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a154a01-3903-4293-ac7d-de8db22c0119 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:28.058608 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a154a01-3903-4293-ac7d-de8db22c0119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:28.058877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a154a01-3903-4293-ac7d-de8db22c0119 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:28.066563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a154a01-3903-4293-ac7d-de8db22c0119 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:28.068250 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a154a01-3903-4293-ac7d-de8db22c0119 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:28.076709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 556/1126] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:28 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:28.082852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1eeacf-e128-49fb-a30d-e518de1d0186 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:28.092736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1eeacf-e128-49fb-a30d-e518de1d0186 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:28.097197 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd73846-2ce4-4a5d-969a-8b3d405644c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:28.098045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73846-2ce4-4a5d-969a-8b3d405644c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:28.098322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73846-2ce4-4a5d-969a-8b3d405644c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:28.098595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73846-2ce4-4a5d-969a-8b3d405644c3 admin admin] PATH_INFO: `/v3/projects/636b7fb257994dcead9044c148b93428` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:28.099751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd73846-2ce4-4a5d-969a-8b3d405644c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=636b7fb257994dcead9044c148b93428)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:28.102515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd73846-2ce4-4a5d-969a-8b3d405644c3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:28.104117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 571/1127] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:28 2021] GET /identity/v3/projects/636b7fb257994dcead9044c148b93428 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:28.110316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a154a01-3903-4293-ac7d-de8db22c0119 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:28.118926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a154a01-3903-4293-ac7d-de8db22c0119 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:28.123397 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e2866-a379-489a-a56b-7fe92208bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:28.124010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e2866-a379-489a-a56b-7fe92208bbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:28.124284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e2866-a379-489a-a56b-7fe92208bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:28.124548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e2866-a379-489a-a56b-7fe92208bbe2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:28.125366 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e2866-a379-489a-a56b-7fe92208bbe2 admin admin] RBAC: Adding query filter params (role.id=78ec5da190bd41768cafe7cade4d3d69, scope.project.id=636b7fb257994dcead9044c148b93428, user.id=80deca3f967741ef9e5a51aeb02494f8) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:28.125670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e2866-a379-489a-a56b-7fe92208bbe2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:28.127497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e2866-a379-489a-a56b-7fe92208bbe2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:28.133551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 557/1128] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:25:28 2021] GET /identity/v3/role_assignments?user.id=80deca3f967741ef9e5a51aeb02494f8&scope.project.id=636b7fb257994dcead9044c148b93428&role.id=78ec5da190bd41768cafe7cade4d3d69 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:30.491715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68cce-6eec-4f8a-b5df-542f14516eb2 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:30.492279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68cce-6eec-4f8a-b5df-542f14516eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:30.492279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68cce-6eec-4f8a-b5df-542f14516eb2 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:30.494044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 572/1129] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:30.500281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045f3c4-a899-4a91-b1ce-f5068e052ad1 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:30.500729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045f3c4-a899-4a91-b1ce-f5068e052ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:30.500822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045f3c4-a899-4a91-b1ce-f5068e052ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:30.519824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-8045f3c4-a899-4a91-b1ce-f5068e052ad1 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:30.520993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8045f3c4-a899-4a91-b1ce-f5068e052ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:30.529400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 558/1130] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:30.553421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f68cce-6eec-4f8a-b5df-542f14516eb2 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:30.565518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f68cce-6eec-4f8a-b5df-542f14516eb2 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:30.569807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef39cc7-4945-4aed-a569-eac8ef425b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:30.571069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef39cc7-4945-4aed-a569-eac8ef425b64 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:30.571342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef39cc7-4945-4aed-a569-eac8ef425b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:30.571612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef39cc7-4945-4aed-a569-eac8ef425b64 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:30.572758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef39cc7-4945-4aed-a569-eac8ef425b64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:30.574439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef39cc7-4945-4aed-a569-eac8ef425b64 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:30.575968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 573/1131] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:30.582146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045f3c4-a899-4a91-b1ce-f5068e052ad1 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:30.591762 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045f3c4-a899-4a91-b1ce-f5068e052ad1 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:30.596272 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caabc80-8d0b-4e70-9398-9acc3541ee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:30.596921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caabc80-8d0b-4e70-9398-9acc3541ee9e admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:30.597202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caabc80-8d0b-4e70-9398-9acc3541ee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:30.597475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caabc80-8d0b-4e70-9398-9acc3541ee9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:30.598224 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caabc80-8d0b-4e70-9398-9acc3541ee9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:30.600100 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caabc80-8d0b-4e70-9398-9acc3541ee9e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:30.625327 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 559/1132] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:25:30 2021] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:25:33.040725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de6e7-2562-46d6-953b-8a439f2acda8 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:33.041232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de6e7-2562-46d6-953b-8a439f2acda8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:33.041232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de6e7-2562-46d6-953b-8a439f2acda8 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:33.042976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 574/1133] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:25:33.048913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0817-554b-4e22-ac9f-9b140ca6484f None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:33.049328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0817-554b-4e22-ac9f-9b140ca6484f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:33.049466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0817-554b-4e22-ac9f-9b140ca6484f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:33.066982 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-de1b0817-554b-4e22-ac9f-9b140ca6484f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:33.068160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-de1b0817-554b-4e22-ac9f-9b140ca6484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:33.123466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 560/1134] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:33.150167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de6e7-2562-46d6-953b-8a439f2acda8 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:33.162193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de6e7-2562-46d6-953b-8a439f2acda8 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:33.167117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af770d-777f-47c2-b8f5-8f867a9321c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:33.167877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af770d-777f-47c2-b8f5-8f867a9321c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:33.168153 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af770d-777f-47c2-b8f5-8f867a9321c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:33.168422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af770d-777f-47c2-b8f5-8f867a9321c2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:33.169587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af770d-777f-47c2-b8f5-8f867a9321c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:33.171262 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af770d-777f-47c2-b8f5-8f867a9321c2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:33.172806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 575/1135] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:25:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:33.179084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b0817-554b-4e22-ac9f-9b140ca6484f None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:33.188222 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b0817-554b-4e22-ac9f-9b140ca6484f None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:33.192846 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d279900-8984-41b0-a2f4-bbdf64316e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:33.193522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279900-8984-41b0-a2f4-bbdf64316e0a admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:33.193830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279900-8984-41b0-a2f4-bbdf64316e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:33.194107 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279900-8984-41b0-a2f4-bbdf64316e0a admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:33.194855 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d279900-8984-41b0-a2f4-bbdf64316e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:33.196765 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d279900-8984-41b0-a2f4-bbdf64316e0a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:33.218792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 561/1136] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:25:33 2021] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:25:35.612314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21768b1-f8f8-4910-9be9-2af2c4a6ed22 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:35.612850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21768b1-f8f8-4910-9be9-2af2c4a6ed22 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:35.612850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21768b1-f8f8-4910-9be9-2af2c4a6ed22 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:35.614663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 576/1137] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:35.620644 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bcfda-d9fd-4310-89ed-dcd8f1d9d8ba None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:35.621061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bcfda-d9fd-4310-89ed-dcd8f1d9d8ba None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:35.621181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bcfda-d9fd-4310-89ed-dcd8f1d9d8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:35.639302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c43bcfda-d9fd-4310-89ed-dcd8f1d9d8ba None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:35.640664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c43bcfda-d9fd-4310-89ed-dcd8f1d9d8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:35.648061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 562/1138] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:35.673192 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21768b1-f8f8-4910-9be9-2af2c4a6ed22 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:35.685391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21768b1-f8f8-4910-9be9-2af2c4a6ed22 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:35.690503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcea2e1-276d-4e4e-bc35-6fe035931068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:35.691028 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcea2e1-276d-4e4e-bc35-6fe035931068 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:35.691313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcea2e1-276d-4e4e-bc35-6fe035931068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:35.691589 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcea2e1-276d-4e4e-bc35-6fe035931068 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:35.702197 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcea2e1-276d-4e4e-bc35-6fe035931068 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:35.709044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-8dcea2e1-276d-4e4e-bc35-6fe035931068 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:25:35.710227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 577/1139] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:25:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:35.717356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bcfda-d9fd-4310-89ed-dcd8f1d9d8ba None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:35.726297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bcfda-d9fd-4310-89ed-dcd8f1d9d8ba None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:35.730844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7349a1-91ec-4134-8d59-a1516b666cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:35.731496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7349a1-91ec-4134-8d59-a1516b666cdf admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:35.731806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7349a1-91ec-4134-8d59-a1516b666cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:35.732049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7349a1-91ec-4134-8d59-a1516b666cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:35.732803 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7349a1-91ec-4134-8d59-a1516b666cdf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:35.733104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7349a1-91ec-4134-8d59-a1516b666cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:35.734711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7349a1-91ec-4134-8d59-a1516b666cdf admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:35.742747 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 563/1140] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:25:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:35.749053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcea2e1-276d-4e4e-bc35-6fe035931068 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:35.759857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcea2e1-276d-4e4e-bc35-6fe035931068 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:35.764565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182208e-f6dc-4af1-b8f0-c9b6e0e925df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:35.765409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182208e-f6dc-4af1-b8f0-c9b6e0e925df admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:35.765689 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182208e-f6dc-4af1-b8f0-c9b6e0e925df admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:35.766004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182208e-f6dc-4af1-b8f0-c9b6e0e925df admin admin] PATH_INFO: `/v3/users/54e443b5f2ce4ccd8f6de3181643e313` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:35.780348 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182208e-f6dc-4af1-b8f0-c9b6e0e925df admin admin] RBAC: Authorizing `identity:get_user(user_id=54e443b5f2ce4ccd8f6de3181643e313)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:35.782606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182208e-f6dc-4af1-b8f0-c9b6e0e925df admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:35.784235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 578/1141] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:35 2021] GET /identity/v3/users/54e443b5f2ce4ccd8f6de3181643e313 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:35.790668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7349a1-91ec-4134-8d59-a1516b666cdf admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:35.800236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7349a1-91ec-4134-8d59-a1516b666cdf admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:35.804769 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956b117-0dff-462c-aab6-68a5d1e89c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:35.805395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956b117-0dff-462c-aab6-68a5d1e89c5b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:35.805672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956b117-0dff-462c-aab6-68a5d1e89c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:35.805970 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956b117-0dff-462c-aab6-68a5d1e89c5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:35.814864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956b117-0dff-462c-aab6-68a5d1e89c5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:35.818160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956b117-0dff-462c-aab6-68a5d1e89c5b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:35.827641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 564/1142] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:35 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:35.834004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182208e-f6dc-4af1-b8f0-c9b6e0e925df admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:35.844147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182208e-f6dc-4af1-b8f0-c9b6e0e925df admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:35.848638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12f336-a213-41e6-86bb-d1d9b1ff19f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:35.849469 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12f336-a213-41e6-86bb-d1d9b1ff19f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:35.849742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12f336-a213-41e6-86bb-d1d9b1ff19f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:35.850036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12f336-a213-41e6-86bb-d1d9b1ff19f3 admin admin] PATH_INFO: `/v3/projects/2803bc9c722944d2b7b97399c886aa48` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:35.851194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12f336-a213-41e6-86bb-d1d9b1ff19f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=2803bc9c722944d2b7b97399c886aa48)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:35.853220 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12f336-a213-41e6-86bb-d1d9b1ff19f3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:35.854864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 579/1143] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:35 2021] GET /identity/v3/projects/2803bc9c722944d2b7b97399c886aa48 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:35.861258 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956b117-0dff-462c-aab6-68a5d1e89c5b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:35.870496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956b117-0dff-462c-aab6-68a5d1e89c5b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:35.875045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f474ec5-7fc6-45c0-9d29-e11fac81de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:35.875684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f474ec5-7fc6-45c0-9d29-e11fac81de3b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:35.875965 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f474ec5-7fc6-45c0-9d29-e11fac81de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:35.876262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f474ec5-7fc6-45c0-9d29-e11fac81de3b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:35.877085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f474ec5-7fc6-45c0-9d29-e11fac81de3b admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=2803bc9c722944d2b7b97399c886aa48, user.id=54e443b5f2ce4ccd8f6de3181643e313) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:35.877399 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f474ec5-7fc6-45c0-9d29-e11fac81de3b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:35.879360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f474ec5-7fc6-45c0-9d29-e11fac81de3b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:35.885379 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 565/1144] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:25:35 2021] GET /identity/v3/role_assignments?user.id=54e443b5f2ce4ccd8f6de3181643e313&scope.project.id=2803bc9c722944d2b7b97399c886aa48&role.id=a312b345efeb490eb4234d1ace386dec => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:38.239538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7543b-fa78-4a9e-9875-2f0aef55610d None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:38.240129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7543b-fa78-4a9e-9875-2f0aef55610d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:38.240129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7543b-fa78-4a9e-9875-2f0aef55610d None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:38.241975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 580/1145] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:38.248489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe638-2574-4e94-a85f-988d0a30366d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:38.248938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe638-2574-4e94-a85f-988d0a30366d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:38.249048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe638-2574-4e94-a85f-988d0a30366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:38.266456 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-dafbe638-2574-4e94-a85f-988d0a30366d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:38.267643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-dafbe638-2574-4e94-a85f-988d0a30366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:38.275855 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 566/1146] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:38.300045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7543b-fa78-4a9e-9875-2f0aef55610d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:38.311895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7543b-fa78-4a9e-9875-2f0aef55610d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:38.316459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ce0ee-9b03-4270-ba37-49c57f10e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:38.317222 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ce0ee-9b03-4270-ba37-49c57f10e6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:38.317498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ce0ee-9b03-4270-ba37-49c57f10e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:38.317791 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ce0ee-9b03-4270-ba37-49c57f10e6a3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:38.327916 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ce0ee-9b03-4270-ba37-49c57f10e6a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:38.334589 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-4a2ce0ee-9b03-4270-ba37-49c57f10e6a3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:25:38.335719 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 581/1147] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:25:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:38.342571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe638-2574-4e94-a85f-988d0a30366d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:38.351610 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe638-2574-4e94-a85f-988d0a30366d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:38.356701 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3cf9d-931e-49fb-a4bb-d959b31bb5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:38.357345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3cf9d-931e-49fb-a4bb-d959b31bb5ae admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:38.357625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3cf9d-931e-49fb-a4bb-d959b31bb5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:38.357935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3cf9d-931e-49fb-a4bb-d959b31bb5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:38.358682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3cf9d-931e-49fb-a4bb-d959b31bb5ae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:38.358982 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3cf9d-931e-49fb-a4bb-d959b31bb5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:38.360540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3cf9d-931e-49fb-a4bb-d959b31bb5ae admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:38.368777 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 567/1148] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:25:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:38.375171 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ce0ee-9b03-4270-ba37-49c57f10e6a3 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:38.385943 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ce0ee-9b03-4270-ba37-49c57f10e6a3 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:38.390469 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f607b3-94d5-4ab8-ac99-afdffe4e5fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:38.391309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f607b3-94d5-4ab8-ac99-afdffe4e5fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:38.391671 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f607b3-94d5-4ab8-ac99-afdffe4e5fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:38.392047 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f607b3-94d5-4ab8-ac99-afdffe4e5fc6 admin admin] PATH_INFO: `/v3/users/54e443b5f2ce4ccd8f6de3181643e313` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:38.393254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f607b3-94d5-4ab8-ac99-afdffe4e5fc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=54e443b5f2ce4ccd8f6de3181643e313)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:38.395370 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f607b3-94d5-4ab8-ac99-afdffe4e5fc6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:38.396938 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 582/1149] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:38 2021] GET /identity/v3/users/54e443b5f2ce4ccd8f6de3181643e313 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:38.403425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3cf9d-931e-49fb-a4bb-d959b31bb5ae admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:38.412833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3cf9d-931e-49fb-a4bb-d959b31bb5ae admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:38.417987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a5cc9-38f4-4712-92db-813d0e1402b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:38.418827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a5cc9-38f4-4712-92db-813d0e1402b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:38.419101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a5cc9-38f4-4712-92db-813d0e1402b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:38.419370 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a5cc9-38f4-4712-92db-813d0e1402b8 admin admin] PATH_INFO: `/v3/projects/2803bc9c722944d2b7b97399c886aa48` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:38.420526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a5cc9-38f4-4712-92db-813d0e1402b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=2803bc9c722944d2b7b97399c886aa48)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:38.422599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a5cc9-38f4-4712-92db-813d0e1402b8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:38.424217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 568/1150] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:38 2021] GET /identity/v3/projects/2803bc9c722944d2b7b97399c886aa48 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:38.430573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f607b3-94d5-4ab8-ac99-afdffe4e5fc6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:38.440535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f607b3-94d5-4ab8-ac99-afdffe4e5fc6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:38.445143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189c84a-cffa-40c6-b110-45546adf3c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:38.446138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189c84a-cffa-40c6-b110-45546adf3c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:38.446421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189c84a-cffa-40c6-b110-45546adf3c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:38.446694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189c84a-cffa-40c6-b110-45546adf3c06 admin admin] PATH_INFO: `/v3/projects/2803bc9c722944d2b7b97399c886aa48/users/54e443b5f2ce4ccd8f6de3181643e313/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:38.448713 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189c84a-cffa-40c6-b110-45546adf3c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2803bc9c722944d2b7b97399c886aa48, user_id=54e443b5f2ce4ccd8f6de3181643e313, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:38.451331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189c84a-cffa-40c6-b110-45546adf3c06 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:38.465748 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 583/1151] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:25:38 2021] PUT /identity/v3/projects/2803bc9c722944d2b7b97399c886aa48/users/54e443b5f2ce4ccd8f6de3181643e313/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:25:40.783007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cce86-1f13-427c-81b6-cb825d70bc28 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:40.783556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cce86-1f13-427c-81b6-cb825d70bc28 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:40.783556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cce86-1f13-427c-81b6-cb825d70bc28 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:40.785301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 569/1152] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:40.791440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc1ce-7b10-4d81-b255-3832ac8ee617 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:40.791828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc1ce-7b10-4d81-b255-3832ac8ee617 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:40.791977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc1ce-7b10-4d81-b255-3832ac8ee617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:40.809027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5a2dc1ce-7b10-4d81-b255-3832ac8ee617 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:40.810225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5a2dc1ce-7b10-4d81-b255-3832ac8ee617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:40.864544 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 584/1153] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:40.888783 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cce86-1f13-427c-81b6-cb825d70bc28 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:40.901199 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cce86-1f13-427c-81b6-cb825d70bc28 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:40.905655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679caf6-dae8-4b80-b3e4-abe813750634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:40.906396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679caf6-dae8-4b80-b3e4-abe813750634 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:40.906672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679caf6-dae8-4b80-b3e4-abe813750634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:40.906941 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679caf6-dae8-4b80-b3e4-abe813750634 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:40.916830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679caf6-dae8-4b80-b3e4-abe813750634 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:40.923540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-c679caf6-dae8-4b80-b3e4-abe813750634 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:25:40.924655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 570/1154] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:25:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:40.930722 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dc1ce-7b10-4d81-b255-3832ac8ee617 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:40.939714 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dc1ce-7b10-4d81-b255-3832ac8ee617 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:40.944142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a572950-4688-4a5f-84ec-b8de23f54af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:40.944789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a572950-4688-4a5f-84ec-b8de23f54af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:40.945062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a572950-4688-4a5f-84ec-b8de23f54af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:40.945332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a572950-4688-4a5f-84ec-b8de23f54af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:40.946608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a572950-4688-4a5f-84ec-b8de23f54af7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:40.946909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a572950-4688-4a5f-84ec-b8de23f54af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:40.948455 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a572950-4688-4a5f-84ec-b8de23f54af7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:40.956400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 585/1155] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:25:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:40.963069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679caf6-dae8-4b80-b3e4-abe813750634 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:40.973426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679caf6-dae8-4b80-b3e4-abe813750634 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:40.978037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0f09-ba46-4450-babf-cd585c959cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:40.978864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0f09-ba46-4450-babf-cd585c959cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:40.979134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0f09-ba46-4450-babf-cd585c959cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:40.979398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0f09-ba46-4450-babf-cd585c959cc7 admin admin] PATH_INFO: `/v3/users/54e443b5f2ce4ccd8f6de3181643e313` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:40.980579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0f09-ba46-4450-babf-cd585c959cc7 admin admin] RBAC: Authorizing `identity:get_user(user_id=54e443b5f2ce4ccd8f6de3181643e313)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:40.982702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0f09-ba46-4450-babf-cd585c959cc7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:40.984233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 571/1156] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:40 2021] GET /identity/v3/users/54e443b5f2ce4ccd8f6de3181643e313 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:40.989994 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a572950-4688-4a5f-84ec-b8de23f54af7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:40.999216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a572950-4688-4a5f-84ec-b8de23f54af7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:41.003627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04117b4f-03ad-4f01-81ff-1a0d222f27f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:41.004241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04117b4f-03ad-4f01-81ff-1a0d222f27f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:41.004518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04117b4f-03ad-4f01-81ff-1a0d222f27f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:41.004788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04117b4f-03ad-4f01-81ff-1a0d222f27f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:41.012690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04117b4f-03ad-4f01-81ff-1a0d222f27f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:41.014413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04117b4f-03ad-4f01-81ff-1a0d222f27f5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:41.022966 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 586/1157] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:40 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:41.029475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0f09-ba46-4450-babf-cd585c959cc7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:41.038745 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0f09-ba46-4450-babf-cd585c959cc7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:41.043119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded233b0-cffe-4d62-b483-fddab4211fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:41.043928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded233b0-cffe-4d62-b483-fddab4211fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:41.044202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded233b0-cffe-4d62-b483-fddab4211fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:41.044471 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded233b0-cffe-4d62-b483-fddab4211fa9 admin admin] PATH_INFO: `/v3/projects/2803bc9c722944d2b7b97399c886aa48` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:41.045619 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded233b0-cffe-4d62-b483-fddab4211fa9 admin admin] RBAC: Authorizing `identity:get_project(project_id=2803bc9c722944d2b7b97399c886aa48)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:41.047640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded233b0-cffe-4d62-b483-fddab4211fa9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:41.049238 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 572/1158] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:41 2021] GET /identity/v3/projects/2803bc9c722944d2b7b97399c886aa48 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:41.055290 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04117b4f-03ad-4f01-81ff-1a0d222f27f5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:41.064099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04117b4f-03ad-4f01-81ff-1a0d222f27f5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:41.068581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0f09f-e01f-48ca-8ff9-dbaf9f0f99c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:41.069195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0f09f-e01f-48ca-8ff9-dbaf9f0f99c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:41.069475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0f09f-e01f-48ca-8ff9-dbaf9f0f99c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:41.069776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0f09f-e01f-48ca-8ff9-dbaf9f0f99c4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:41.071101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0f09f-e01f-48ca-8ff9-dbaf9f0f99c4 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=2803bc9c722944d2b7b97399c886aa48, user.id=54e443b5f2ce4ccd8f6de3181643e313) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:41.071411 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0f09f-e01f-48ca-8ff9-dbaf9f0f99c4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:41.073208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0f09f-e01f-48ca-8ff9-dbaf9f0f99c4 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:41.078881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 587/1159] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:25:41 2021] GET /identity/v3/role_assignments?user.id=54e443b5f2ce4ccd8f6de3181643e313&scope.project.id=2803bc9c722944d2b7b97399c886aa48&role.id=a312b345efeb490eb4234d1ace386dec => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:43.422615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c357e7-0c32-4023-81d0-5d3af12934cc None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:43.423181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c357e7-0c32-4023-81d0-5d3af12934cc None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:43.423181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c357e7-0c32-4023-81d0-5d3af12934cc None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:43.424926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 573/1160] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:43.431415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765fceb-d86a-4dbb-8408-a31d6003e724 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:43.431866 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765fceb-d86a-4dbb-8408-a31d6003e724 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:43.431954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765fceb-d86a-4dbb-8408-a31d6003e724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:43.450190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-3765fceb-d86a-4dbb-8408-a31d6003e724 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:43.451378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3765fceb-d86a-4dbb-8408-a31d6003e724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:43.458975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 588/1161] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:43.482654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c357e7-0c32-4023-81d0-5d3af12934cc None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:43.495757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c357e7-0c32-4023-81d0-5d3af12934cc None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:43.500326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef859baf-68e2-43ae-bc83-30e921e809cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:43.500963 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859baf-68e2-43ae-bc83-30e921e809cb admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:43.501239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859baf-68e2-43ae-bc83-30e921e809cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:43.501505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859baf-68e2-43ae-bc83-30e921e809cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:43.509303 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef859baf-68e2-43ae-bc83-30e921e809cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:43.511068 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef859baf-68e2-43ae-bc83-30e921e809cb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:43.519704 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 574/1162] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:43 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:43.529689 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765fceb-d86a-4dbb-8408-a31d6003e724 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:43.535679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765fceb-d86a-4dbb-8408-a31d6003e724 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:43.540767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25ceed-2b8e-4156-b9d4-64c3392c4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:43.541551 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ceed-2b8e-4156-b9d4-64c3392c4f25 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:43.541860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ceed-2b8e-4156-b9d4-64c3392c4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:43.542131 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ceed-2b8e-4156-b9d4-64c3392c4f25 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:43.548932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25ceed-2b8e-4156-b9d4-64c3392c4f25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:43.550773 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25ceed-2b8e-4156-b9d4-64c3392c4f25 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:43.564743 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-2d25ceed-2b8e-4156-b9d4-64c3392c4f25 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 15 13:25:43.565920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 589/1163] 10.222.0.83 () {56 vars in 1138 bytes} [Wed Dec 15 13:25:43 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:43.572464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef859baf-68e2-43ae-bc83-30e921e809cb admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:43.581339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef859baf-68e2-43ae-bc83-30e921e809cb admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:43.586004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7eaeb5-394d-4a87-8891-cf6237740b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:43.587153 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eaeb5-394d-4a87-8891-cf6237740b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:43.587432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eaeb5-394d-4a87-8891-cf6237740b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:43.587700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eaeb5-394d-4a87-8891-cf6237740b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:43.588427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eaeb5-394d-4a87-8891-cf6237740b9d admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:43.588725 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eaeb5-394d-4a87-8891-cf6237740b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:43.590325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eaeb5-394d-4a87-8891-cf6237740b9d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:43.597560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 575/1164] 10.222.0.83 () {56 vars in 1136 bytes} [Wed Dec 15 13:25:43 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:45.950570 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f14c6-3e08-4484-904c-0aa68e32e36c None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:45.951067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f14c6-3e08-4484-904c-0aa68e32e36c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:45.951067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f14c6-3e08-4484-904c-0aa68e32e36c None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:45.952794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 590/1165] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:45.958754 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c4948-0ce6-40d1-9873-091b043e24f6 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:45.959176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c4948-0ce6-40d1-9873-091b043e24f6 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:45.959308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c4948-0ce6-40d1-9873-091b043e24f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:45.977070 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-060c4948-0ce6-40d1-9873-091b043e24f6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:45.978289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-060c4948-0ce6-40d1-9873-091b043e24f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:45.986990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 576/1166] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:46.010556 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f14c6-3e08-4484-904c-0aa68e32e36c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:46.023250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f14c6-3e08-4484-904c-0aa68e32e36c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:46.028043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503737c-02e2-43b5-b6d4-f76ff25e0c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:46.028675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503737c-02e2-43b5-b6d4-f76ff25e0c45 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:46.028953 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503737c-02e2-43b5-b6d4-f76ff25e0c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:46.029223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503737c-02e2-43b5-b6d4-f76ff25e0c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:46.030000 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503737c-02e2-43b5-b6d4-f76ff25e0c45 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:46.030996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-e503737c-02e2-43b5-b6d4-f76ff25e0c45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:25:46.030996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:25:46.030996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:25:46.031861 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503737c-02e2-43b5-b6d4-f76ff25e0c45 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:46.047306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 591/1167] 10.222.0.83 () {60 vars in 1159 bytes} [Wed Dec 15 13:25:46 2021] POST /identity/v3/domains => generated 267 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:25:48.378784 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5e432-704b-4607-b815-252fb159e71c None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:48.379313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5e432-704b-4607-b815-252fb159e71c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:48.379313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5e432-704b-4607-b815-252fb159e71c None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:48.381097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 577/1168] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:48.387448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b6c49-7e26-463f-8376-e7021332ead4 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:48.387889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b6c49-7e26-463f-8376-e7021332ead4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:48.387983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b6c49-7e26-463f-8376-e7021332ead4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:48.405816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e59b6c49-7e26-463f-8376-e7021332ead4 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:48.406979 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e59b6c49-7e26-463f-8376-e7021332ead4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:48.462330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 592/1169] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:48.486730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5e432-704b-4607-b815-252fb159e71c None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:48.498599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5e432-704b-4607-b815-252fb159e71c None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:48.503269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc73196-5c93-477b-980f-9ef0469c9857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:48.504142 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc73196-5c93-477b-980f-9ef0469c9857 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:48.504419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc73196-5c93-477b-980f-9ef0469c9857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:48.504687 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc73196-5c93-477b-980f-9ef0469c9857 admin admin] PATH_INFO: `/v3/domains/cc5a6d992f6940fe9252c6e6a9f92ae4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:48.515460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc73196-5c93-477b-980f-9ef0469c9857 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=cc5a6d992f6940fe9252c6e6a9f92ae4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:48.517386 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc73196-5c93-477b-980f-9ef0469c9857 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:48.518996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 578/1170] 10.222.0.83 () {56 vars in 1204 bytes} [Wed Dec 15 13:25:48 2021] GET /identity/v3/domains/cc5a6d992f6940fe9252c6e6a9f92ae4 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:25:48.525665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b6c49-7e26-463f-8376-e7021332ead4 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:48.534690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b6c49-7e26-463f-8376-e7021332ead4 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:48.539283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65d060-51db-42fe-8901-3c3430096b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:48.540004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65d060-51db-42fe-8901-3c3430096b34 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:48.540288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65d060-51db-42fe-8901-3c3430096b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:48.540557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65d060-51db-42fe-8901-3c3430096b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:48.541279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65d060-51db-42fe-8901-3c3430096b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:48.543184 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65d060-51db-42fe-8901-3c3430096b34 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:48.566981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 593/1171] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:25:48 2021] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:25:50.973460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a2d1-df41-440f-9ffb-8d2812646391 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:50.973995 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a2d1-df41-440f-9ffb-8d2812646391 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:50.973995 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a2d1-df41-440f-9ffb-8d2812646391 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:50.975719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 579/1172] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:50.982047 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be202b3c-9f78-4c44-a34a-9d37daac43b9 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:50.982468 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be202b3c-9f78-4c44-a34a-9d37daac43b9 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:50.982602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be202b3c-9f78-4c44-a34a-9d37daac43b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:51.000273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-be202b3c-9f78-4c44-a34a-9d37daac43b9 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:51.001434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-be202b3c-9f78-4c44-a34a-9d37daac43b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:51.055188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 594/1173] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:25:51.080385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40a2d1-df41-440f-9ffb-8d2812646391 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:51.092744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40a2d1-df41-440f-9ffb-8d2812646391 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:51.097084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfe567-f7cf-401c-b378-b89e2d40bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:51.097954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfe567-f7cf-401c-b378-b89e2d40bd16 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:51.098234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfe567-f7cf-401c-b378-b89e2d40bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:51.098502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfe567-f7cf-401c-b378-b89e2d40bd16 admin admin] PATH_INFO: `/v3/domains/cc5a6d992f6940fe9252c6e6a9f92ae4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:51.099671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfe567-f7cf-401c-b378-b89e2d40bd16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=cc5a6d992f6940fe9252c6e6a9f92ae4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:51.101584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfe567-f7cf-401c-b378-b89e2d40bd16 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:51.103794 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 580/1174] 10.222.0.83 () {56 vars in 1204 bytes} [Wed Dec 15 13:25:51 2021] GET /identity/v3/domains/cc5a6d992f6940fe9252c6e6a9f92ae4 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:51.109588 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be202b3c-9f78-4c44-a34a-9d37daac43b9 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:51.118235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be202b3c-9f78-4c44-a34a-9d37daac43b9 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:51.122629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d41ef-3a2d-45b9-9260-349badd240c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:51.123263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d41ef-3a2d-45b9-9260-349badd240c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:51.123537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d41ef-3a2d-45b9-9260-349badd240c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:51.123806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d41ef-3a2d-45b9-9260-349badd240c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:51.124513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d41ef-3a2d-45b9-9260-349badd240c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:51.126421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d41ef-3a2d-45b9-9260-349badd240c2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:51.145132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 595/1175] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:25:51 2021] POST /identity/v3/users => generated 311 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:25:53.549180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248d183-9320-4930-bbb1-e54ba9d4546f None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:53.549715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248d183-9320-4930-bbb1-e54ba9d4546f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:53.549715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248d183-9320-4930-bbb1-e54ba9d4546f None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:53.551517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 581/1176] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:53.557746 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7966-eab4-42d3-91d3-39ace27cd5b3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:53.558208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7966-eab4-42d3-91d3-39ace27cd5b3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:53.558311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7966-eab4-42d3-91d3-39ace27cd5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:53.576328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a05c7966-eab4-42d3-91d3-39ace27cd5b3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:53.577508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a05c7966-eab4-42d3-91d3-39ace27cd5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:53.586834 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 596/1177] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:53.610018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248d183-9320-4930-bbb1-e54ba9d4546f None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:53.622527 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248d183-9320-4930-bbb1-e54ba9d4546f None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:53.626832 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b17b2-65fa-43b2-a2ad-68ff561be4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:53.627621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b17b2-65fa-43b2-a2ad-68ff561be4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:53.627898 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b17b2-65fa-43b2-a2ad-68ff561be4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:53.628169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b17b2-65fa-43b2-a2ad-68ff561be4ab admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:53.641325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b17b2-65fa-43b2-a2ad-68ff561be4ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:53.648147 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-078b17b2-65fa-43b2-a2ad-68ff561be4ab admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:25:53.649323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 582/1178] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:25:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:53.655947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7966-eab4-42d3-91d3-39ace27cd5b3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:53.666133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7966-eab4-42d3-91d3-39ace27cd5b3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:53.671457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21812bc5-9363-4ae8-b0fc-42589207c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:53.672125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21812bc5-9363-4ae8-b0fc-42589207c898 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:53.672409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21812bc5-9363-4ae8-b0fc-42589207c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:53.672685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21812bc5-9363-4ae8-b0fc-42589207c898 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:53.673449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21812bc5-9363-4ae8-b0fc-42589207c898 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:53.673773 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21812bc5-9363-4ae8-b0fc-42589207c898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:53.675465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21812bc5-9363-4ae8-b0fc-42589207c898 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:53.684739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 597/1179] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:25:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:53.691484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b17b2-65fa-43b2-a2ad-68ff561be4ab admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:53.701165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b17b2-65fa-43b2-a2ad-68ff561be4ab admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:53.705645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3703e-fdfa-4d4d-b7d3-e2669f8c5fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:53.706541 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3703e-fdfa-4d4d-b7d3-e2669f8c5fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:53.706822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3703e-fdfa-4d4d-b7d3-e2669f8c5fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:53.707095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3703e-fdfa-4d4d-b7d3-e2669f8c5fe5 admin admin] PATH_INFO: `/v3/users/62abd83b8272429c886cf96aa92b9d40` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:53.720755 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3703e-fdfa-4d4d-b7d3-e2669f8c5fe5 admin admin] RBAC: Authorizing `identity:get_user(user_id=62abd83b8272429c886cf96aa92b9d40)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:53.722914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3703e-fdfa-4d4d-b7d3-e2669f8c5fe5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:53.724592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 583/1180] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:53 2021] GET /identity/v3/users/62abd83b8272429c886cf96aa92b9d40 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:53.731463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21812bc5-9363-4ae8-b0fc-42589207c898 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:53.741136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21812bc5-9363-4ae8-b0fc-42589207c898 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:53.746364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8a1a5-16e6-47e0-b37c-5a9907baf240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:53.747004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a1a5-16e6-47e0-b37c-5a9907baf240 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:53.747277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a1a5-16e6-47e0-b37c-5a9907baf240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:53.747545 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a1a5-16e6-47e0-b37c-5a9907baf240 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:53.755750 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8a1a5-16e6-47e0-b37c-5a9907baf240 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:53.757470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8a1a5-16e6-47e0-b37c-5a9907baf240 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:53.766451 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 598/1181] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:53 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:53.772948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3703e-fdfa-4d4d-b7d3-e2669f8c5fe5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:53.782534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3703e-fdfa-4d4d-b7d3-e2669f8c5fe5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:53.786915 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b279cb3-2bed-42bd-a712-bb6bf9e7a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:53.787751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279cb3-2bed-42bd-a712-bb6bf9e7a5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:53.788024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279cb3-2bed-42bd-a712-bb6bf9e7a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:53.788289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279cb3-2bed-42bd-a712-bb6bf9e7a5b1 admin admin] PATH_INFO: `/v3/projects/d054b782746a446faeefcf75245c016b` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:53.789447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b279cb3-2bed-42bd-a712-bb6bf9e7a5b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=d054b782746a446faeefcf75245c016b)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:53.791978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b279cb3-2bed-42bd-a712-bb6bf9e7a5b1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:53.793595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 584/1182] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:53 2021] GET /identity/v3/projects/d054b782746a446faeefcf75245c016b => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:53.800377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8a1a5-16e6-47e0-b37c-5a9907baf240 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:53.809815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8a1a5-16e6-47e0-b37c-5a9907baf240 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:53.814569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47292f31-c3b4-4bc2-ae34-0e4568a23607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:53.815205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47292f31-c3b4-4bc2-ae34-0e4568a23607 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:53.815483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47292f31-c3b4-4bc2-ae34-0e4568a23607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:53.815758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47292f31-c3b4-4bc2-ae34-0e4568a23607 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:53.816590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47292f31-c3b4-4bc2-ae34-0e4568a23607 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=d054b782746a446faeefcf75245c016b, user.id=62abd83b8272429c886cf96aa92b9d40) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:53.816897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47292f31-c3b4-4bc2-ae34-0e4568a23607 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:53.818772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47292f31-c3b4-4bc2-ae34-0e4568a23607 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:53.824581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 599/1183] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:25:53 2021] GET /identity/v3/role_assignments?user.id=62abd83b8272429c886cf96aa92b9d40&scope.project.id=d054b782746a446faeefcf75245c016b&role.id=a312b345efeb490eb4234d1ace386dec => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:56.231326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b74aa8-4ff9-4309-9f0b-2d6354cfa5c7 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:56.231905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b74aa8-4ff9-4309-9f0b-2d6354cfa5c7 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:56.231905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b74aa8-4ff9-4309-9f0b-2d6354cfa5c7 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:56.233922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 585/1184] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:56.240356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39328569-6e88-4034-88e5-57bf15c3afa8 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:56.240908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39328569-6e88-4034-88e5-57bf15c3afa8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:56.241007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39328569-6e88-4034-88e5-57bf15c3afa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:56.259619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-39328569-6e88-4034-88e5-57bf15c3afa8 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:56.260812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-39328569-6e88-4034-88e5-57bf15c3afa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:56.268420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 600/1185] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:56.291771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b74aa8-4ff9-4309-9f0b-2d6354cfa5c7 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:56.303662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b74aa8-4ff9-4309-9f0b-2d6354cfa5c7 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:56.308450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbebea-31d8-4e89-8d01-829d1638b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:56.309225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbebea-31d8-4e89-8d01-829d1638b4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:56.309504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbebea-31d8-4e89-8d01-829d1638b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:56.309805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbebea-31d8-4e89-8d01-829d1638b4fb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:56.319919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbebea-31d8-4e89-8d01-829d1638b4fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:56.327301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-51bbebea-31d8-4e89-8d01-829d1638b4fb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:25:56.328430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 586/1186] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:25:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:56.334806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39328569-6e88-4034-88e5-57bf15c3afa8 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:56.345475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39328569-6e88-4034-88e5-57bf15c3afa8 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:56.351872 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a164c-58df-4566-b38f-ed8365b32da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:56.352575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a164c-58df-4566-b38f-ed8365b32da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:56.352860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a164c-58df-4566-b38f-ed8365b32da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:56.353082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a164c-58df-4566-b38f-ed8365b32da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:56.353886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a164c-58df-4566-b38f-ed8365b32da1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:56.354191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a164c-58df-4566-b38f-ed8365b32da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:56.355775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a164c-58df-4566-b38f-ed8365b32da1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:56.364455 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 601/1187] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:25:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:56.371804 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbebea-31d8-4e89-8d01-829d1638b4fb admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:56.388013 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbebea-31d8-4e89-8d01-829d1638b4fb admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:56.395100 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb61cb7-1c25-4006-abd0-e8981bef79ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:56.395963 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb61cb7-1c25-4006-abd0-e8981bef79ff admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:56.396239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb61cb7-1c25-4006-abd0-e8981bef79ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:56.396507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb61cb7-1c25-4006-abd0-e8981bef79ff admin admin] PATH_INFO: `/v3/users/62abd83b8272429c886cf96aa92b9d40` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:56.397712 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb61cb7-1c25-4006-abd0-e8981bef79ff admin admin] RBAC: Authorizing `identity:get_user(user_id=62abd83b8272429c886cf96aa92b9d40)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:56.399884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb61cb7-1c25-4006-abd0-e8981bef79ff admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:56.401464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 587/1188] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:56 2021] GET /identity/v3/users/62abd83b8272429c886cf96aa92b9d40 => generated 311 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:56.407778 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a164c-58df-4566-b38f-ed8365b32da1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:56.417488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a164c-58df-4566-b38f-ed8365b32da1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:56.422011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d311c69-0e2b-46ad-9d52-1ac471ab2c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:56.422854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311c69-0e2b-46ad-9d52-1ac471ab2c0d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:56.423133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311c69-0e2b-46ad-9d52-1ac471ab2c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:56.423404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311c69-0e2b-46ad-9d52-1ac471ab2c0d admin admin] PATH_INFO: `/v3/projects/d054b782746a446faeefcf75245c016b` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:56.424596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d311c69-0e2b-46ad-9d52-1ac471ab2c0d admin admin] RBAC: Authorizing `identity:get_project(project_id=d054b782746a446faeefcf75245c016b)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:56.426658 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d311c69-0e2b-46ad-9d52-1ac471ab2c0d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:56.428461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 602/1189] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:56 2021] GET /identity/v3/projects/d054b782746a446faeefcf75245c016b => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:56.435290 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb61cb7-1c25-4006-abd0-e8981bef79ff admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:56.445252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb61cb7-1c25-4006-abd0-e8981bef79ff admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:56.450232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff879f91-7ff8-4893-b6fa-c9f4113cb6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:56.451104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff879f91-7ff8-4893-b6fa-c9f4113cb6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:56.451381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff879f91-7ff8-4893-b6fa-c9f4113cb6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:56.451654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff879f91-7ff8-4893-b6fa-c9f4113cb6e5 admin admin] PATH_INFO: `/v3/projects/d054b782746a446faeefcf75245c016b/users/62abd83b8272429c886cf96aa92b9d40/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:56.453581 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff879f91-7ff8-4893-b6fa-c9f4113cb6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d054b782746a446faeefcf75245c016b, user_id=62abd83b8272429c886cf96aa92b9d40, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:56.456220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff879f91-7ff8-4893-b6fa-c9f4113cb6e5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:56.468834 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 588/1190] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:25:56 2021] PUT /identity/v3/projects/d054b782746a446faeefcf75245c016b/users/62abd83b8272429c886cf96aa92b9d40/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:25:58.823021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4b66b-c2cf-4a42-9b0a-ddeb0be6fb81 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:58.823571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4b66b-c2cf-4a42-9b0a-ddeb0be6fb81 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:58.823571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4b66b-c2cf-4a42-9b0a-ddeb0be6fb81 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:58.825297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 603/1191] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:25:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:25:58.830958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a065f-5555-4f50-b03c-a395e3ac26cb None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:58.831358 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a065f-5555-4f50-b03c-a395e3ac26cb None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:58.831505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a065f-5555-4f50-b03c-a395e3ac26cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:58.849074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-177a065f-5555-4f50-b03c-a395e3ac26cb None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:25:58.850284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-177a065f-5555-4f50-b03c-a395e3ac26cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:25:58.904959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 589/1192] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:25:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:25:58.930196 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4b66b-c2cf-4a42-9b0a-ddeb0be6fb81 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:58.943189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4b66b-c2cf-4a42-9b0a-ddeb0be6fb81 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:58.947505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ecc1e-db0d-4a04-9c0a-104d1b68a8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:58.948276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecc1e-db0d-4a04-9c0a-104d1b68a8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:58.948559 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecc1e-db0d-4a04-9c0a-104d1b68a8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:58.948836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecc1e-db0d-4a04-9c0a-104d1b68a8c5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:58.958945 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ecc1e-db0d-4a04-9c0a-104d1b68a8c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:25:58.965692 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-178ecc1e-db0d-4a04-9c0a-104d1b68a8c5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:25:58.966852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 604/1193] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:25:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:25:58.973124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a065f-5555-4f50-b03c-a395e3ac26cb None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:58.982345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a065f-5555-4f50-b03c-a395e3ac26cb None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:58.986813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2be0f7-31e6-492c-9f36-2d29d0761ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:58.987457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2be0f7-31e6-492c-9f36-2d29d0761ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:58.987734 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2be0f7-31e6-492c-9f36-2d29d0761ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:58.988007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2be0f7-31e6-492c-9f36-2d29d0761ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:58.988757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2be0f7-31e6-492c-9f36-2d29d0761ed3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:58.989060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2be0f7-31e6-492c-9f36-2d29d0761ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:58.990665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2be0f7-31e6-492c-9f36-2d29d0761ed3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:58.999199 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 590/1194] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:25:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:59.005284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ecc1e-db0d-4a04-9c0a-104d1b68a8c5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:59.015263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ecc1e-db0d-4a04-9c0a-104d1b68a8c5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:59.020396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e91b9-4da8-44f4-abd0-7657664b6a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:59.021240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e91b9-4da8-44f4-abd0-7657664b6a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:59.021602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e91b9-4da8-44f4-abd0-7657664b6a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:59.021919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e91b9-4da8-44f4-abd0-7657664b6a17 admin admin] PATH_INFO: `/v3/users/62abd83b8272429c886cf96aa92b9d40` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:59.023125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e91b9-4da8-44f4-abd0-7657664b6a17 admin admin] RBAC: Authorizing `identity:get_user(user_id=62abd83b8272429c886cf96aa92b9d40)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:59.025274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e91b9-4da8-44f4-abd0-7657664b6a17 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:59.026875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 605/1195] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Dec 15 13:25:59 2021] GET /identity/v3/users/62abd83b8272429c886cf96aa92b9d40 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:59.032909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2be0f7-31e6-492c-9f36-2d29d0761ed3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:59.042846 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2be0f7-31e6-492c-9f36-2d29d0761ed3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:59.047595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7bb8e-1208-458e-87e7-da91c0276103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:59.048216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bb8e-1208-458e-87e7-da91c0276103 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:59.048499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bb8e-1208-458e-87e7-da91c0276103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:59.048774 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bb8e-1208-458e-87e7-da91c0276103 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:59.056892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7bb8e-1208-458e-87e7-da91c0276103 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:59.058639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7bb8e-1208-458e-87e7-da91c0276103 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:59.067465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 591/1196] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:25:59 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:59.073336 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e91b9-4da8-44f4-abd0-7657664b6a17 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:59.082761 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e91b9-4da8-44f4-abd0-7657664b6a17 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:59.087194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d8d0a-994e-4ec3-bf59-51f463c261ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:59.088012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d8d0a-994e-4ec3-bf59-51f463c261ec admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:59.088294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d8d0a-994e-4ec3-bf59-51f463c261ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:59.088564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d8d0a-994e-4ec3-bf59-51f463c261ec admin admin] PATH_INFO: `/v3/projects/d054b782746a446faeefcf75245c016b` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:59.089720 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d8d0a-994e-4ec3-bf59-51f463c261ec admin admin] RBAC: Authorizing `identity:get_project(project_id=d054b782746a446faeefcf75245c016b)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:59.091718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d8d0a-994e-4ec3-bf59-51f463c261ec admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:59.093322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 606/1197] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:25:59 2021] GET /identity/v3/projects/d054b782746a446faeefcf75245c016b => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:25:59.099343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7bb8e-1208-458e-87e7-da91c0276103 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:25:59.108238 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7bb8e-1208-458e-87e7-da91c0276103 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:25:59.112738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da97cc-4391-4861-a14b-3758779aa0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:25:59.113346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da97cc-4391-4861-a14b-3758779aa0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:25:59.113626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da97cc-4391-4861-a14b-3758779aa0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:25:59.113937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da97cc-4391-4861-a14b-3758779aa0e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:25:59.114758 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da97cc-4391-4861-a14b-3758779aa0e6 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=d054b782746a446faeefcf75245c016b, user.id=62abd83b8272429c886cf96aa92b9d40) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:25:59.115064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da97cc-4391-4861-a14b-3758779aa0e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:25:59.116841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da97cc-4391-4861-a14b-3758779aa0e6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:25:59.123000 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 592/1198] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:25:59 2021] GET /identity/v3/role_assignments?user.id=62abd83b8272429c886cf96aa92b9d40&scope.project.id=d054b782746a446faeefcf75245c016b&role.id=a312b345efeb490eb4234d1ace386dec => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:26:58.166387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b584-b6ae-45a5-a8b1-17fe03ea490a None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:58.167041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b584-b6ae-45a5-a8b1-17fe03ea490a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:58.167041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b584-b6ae-45a5-a8b1-17fe03ea490a None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:58.169250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 607/1199] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:26:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:26:58.177731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086bc7-8788-4017-8f08-bd80dbde743b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:58.177731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086bc7-8788-4017-8f08-bd80dbde743b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:58.177731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086bc7-8788-4017-8f08-bd80dbde743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:58.198337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-ae086bc7-8788-4017-8f08-bd80dbde743b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:26:58.200134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ae086bc7-8788-4017-8f08-bd80dbde743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:26:58.209064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 593/1200] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:26:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:26:58.237831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8b584-b6ae-45a5-a8b1-17fe03ea490a None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:26:58.255896 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8b584-b6ae-45a5-a8b1-17fe03ea490a None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:26:58.261788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8758e58-d0a8-4b68-81ad-46d6f36777b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:26:58.263891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8758e58-d0a8-4b68-81ad-46d6f36777b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:58.263891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8758e58-d0a8-4b68-81ad-46d6f36777b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:58.263891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8758e58-d0a8-4b68-81ad-46d6f36777b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:58.275079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8758e58-d0a8-4b68-81ad-46d6f36777b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:26:58.277083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8758e58-d0a8-4b68-81ad-46d6f36777b2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:26:58.297439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-f8758e58-d0a8-4b68-81ad-46d6f36777b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:26:58.298760 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 608/1201] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:26:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:26:58.307233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae086bc7-8788-4017-8f08-bd80dbde743b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:26:58.318174 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae086bc7-8788-4017-8f08-bd80dbde743b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:26:58.323862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0267c-378d-49fa-9cfc-dfdb35fb7360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:26:58.324839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0267c-378d-49fa-9cfc-dfdb35fb7360 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:58.325335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0267c-378d-49fa-9cfc-dfdb35fb7360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:58.325667 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0267c-378d-49fa-9cfc-dfdb35fb7360 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:58.326506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0267c-378d-49fa-9cfc-dfdb35fb7360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:26:58.326804 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0267c-378d-49fa-9cfc-dfdb35fb7360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:26:58.328442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0267c-378d-49fa-9cfc-dfdb35fb7360 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:26:58.342027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 594/1202] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:26:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:26:58.349478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8758e58-d0a8-4b68-81ad-46d6f36777b2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:26:58.365920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8758e58-d0a8-4b68-81ad-46d6f36777b2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:26:58.375656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070898c-d084-4c62-9ade-fc79dc336595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:26:58.376405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070898c-d084-4c62-9ade-fc79dc336595 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:26:58.376703 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070898c-d084-4c62-9ade-fc79dc336595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:26:58.376983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070898c-d084-4c62-9ade-fc79dc336595 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:26:58.377832 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070898c-d084-4c62-9ade-fc79dc336595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:26:58.381328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070898c-d084-4c62-9ade-fc79dc336595 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:26:58.409806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 609/1203] 10.222.0.83 () {60 vars in 1153 bytes} [Wed Dec 15 13:26:58 2021] POST /identity/v3/users => generated 251 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:27:01.031875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68030021-199a-4384-b353-ad0a83d5afc2 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.032570 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68030021-199a-4384-b353-ad0a83d5afc2 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.032570 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68030021-199a-4384-b353-ad0a83d5afc2 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.034344 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 595/1204] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:27:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:27:01.040765 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcfb4c-aaca-48a6-8dec-397c255851b6 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.041448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcfb4c-aaca-48a6-8dec-397c255851b6 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.041448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcfb4c-aaca-48a6-8dec-397c255851b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.060697 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-32fcfb4c-aaca-48a6-8dec-397c255851b6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:01.061938 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-32fcfb4c-aaca-48a6-8dec-397c255851b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:01.070415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 610/1205] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:27:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:27:01.095915 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68030021-199a-4384-b353-ad0a83d5afc2 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.109681 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68030021-199a-4384-b353-ad0a83d5afc2 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.115055 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1ccd3-451e-48e2-945d-acc21221919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.116994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1ccd3-451e-48e2-945d-acc21221919b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.116994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1ccd3-451e-48e2-945d-acc21221919b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.116994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1ccd3-451e-48e2-945d-acc21221919b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.132504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1ccd3-451e-48e2-945d-acc21221919b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:27:01.139880 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-a7f1ccd3-451e-48e2-945d-acc21221919b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:27:01.141083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 596/1206] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:27:01.147783 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcfb4c-aaca-48a6-8dec-397c255851b6 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.161730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcfb4c-aaca-48a6-8dec-397c255851b6 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.166681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef010f7-30c4-486d-be7e-552f6225715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.167704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef010f7-30c4-486d-be7e-552f6225715a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.167704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef010f7-30c4-486d-be7e-552f6225715a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.167989 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef010f7-30c4-486d-be7e-552f6225715a admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.168754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef010f7-30c4-486d-be7e-552f6225715a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:01.169057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef010f7-30c4-486d-be7e-552f6225715a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:01.170681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef010f7-30c4-486d-be7e-552f6225715a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:01.179717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 611/1207] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:01.186170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1ccd3-451e-48e2-945d-acc21221919b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.196651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1ccd3-451e-48e2-945d-acc21221919b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.202306 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0cdfa-6ef1-477a-922d-04b8fff19f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.203392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0cdfa-6ef1-477a-922d-04b8fff19f39 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.203703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0cdfa-6ef1-477a-922d-04b8fff19f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.204010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0cdfa-6ef1-477a-922d-04b8fff19f39 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.220125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0cdfa-6ef1-477a-922d-04b8fff19f39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:01.222160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0cdfa-6ef1-477a-922d-04b8fff19f39 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:01.241414 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-a0a0cdfa-6ef1-477a-922d-04b8fff19f39 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:01.242713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 597/1208] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:01.249526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef010f7-30c4-486d-be7e-552f6225715a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.260447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef010f7-30c4-486d-be7e-552f6225715a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.268616 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcc25e-e4bb-4ac1-a621-4cf3b1ec9bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.270765 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc25e-e4bb-4ac1-a621-4cf3b1ec9bad admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.271312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc25e-e4bb-4ac1-a621-4cf3b1ec9bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.271863 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc25e-e4bb-4ac1-a621-4cf3b1ec9bad admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.273175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcc25e-e4bb-4ac1-a621-4cf3b1ec9bad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:01.273600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcc25e-e4bb-4ac1-a621-4cf3b1ec9bad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:01.275476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcc25e-e4bb-4ac1-a621-4cf3b1ec9bad admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:01.297342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 612/1209] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:01.302605 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0cdfa-6ef1-477a-922d-04b8fff19f39 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.313441 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0cdfa-6ef1-477a-922d-04b8fff19f39 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.318875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a96d7-970f-404c-a848-2bdc67206ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.319744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a96d7-970f-404c-a848-2bdc67206ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.320026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a96d7-970f-404c-a848-2bdc67206ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.320334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a96d7-970f-404c-a848-2bdc67206ad3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.329578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a96d7-970f-404c-a848-2bdc67206ad3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:01.332195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a96d7-970f-404c-a848-2bdc67206ad3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:01.350788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-702a96d7-970f-404c-a848-2bdc67206ad3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:27:01.358080 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 598/1210] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/users/placement => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:27:01.360191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcc25e-e4bb-4ac1-a621-4cf3b1ec9bad admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.375666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcc25e-e4bb-4ac1-a621-4cf3b1ec9bad admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.381105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969934e-a29c-4d15-8ae4-5c605f446389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.382005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969934e-a29c-4d15-8ae4-5c605f446389 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.382403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969934e-a29c-4d15-8ae4-5c605f446389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.382781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969934e-a29c-4d15-8ae4-5c605f446389 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.383830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969934e-a29c-4d15-8ae4-5c605f446389 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:01.384277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969934e-a29c-4d15-8ae4-5c605f446389 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:01.387056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969934e-a29c-4d15-8ae4-5c605f446389 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:01.412082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 613/1211] 10.222.0.83 () {56 vars in 1164 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:01.418806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a96d7-970f-404c-a848-2bdc67206ad3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.431618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a96d7-970f-404c-a848-2bdc67206ad3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.436919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7542e-8b06-4caa-ac4a-92dc3d4778d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.437748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7542e-8b06-4caa-ac4a-92dc3d4778d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.438174 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7542e-8b06-4caa-ac4a-92dc3d4778d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.438543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7542e-8b06-4caa-ac4a-92dc3d4778d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.451216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7542e-8b06-4caa-ac4a-92dc3d4778d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:01.453254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7542e-8b06-4caa-ac4a-92dc3d4778d3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:01.464076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 599/1212] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:27:01.471214 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969934e-a29c-4d15-8ae4-5c605f446389 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.483903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969934e-a29c-4d15-8ae4-5c605f446389 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.488856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d818f8a-ff88-478c-8153-a9144e52d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.489646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d818f8a-ff88-478c-8153-a9144e52d694 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.489980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d818f8a-ff88-478c-8153-a9144e52d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.490331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d818f8a-ff88-478c-8153-a9144e52d694 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.502795 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d818f8a-ff88-478c-8153-a9144e52d694 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:01.504922 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d818f8a-ff88-478c-8153-a9144e52d694 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:01.524038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-6d818f8a-ff88-478c-8153-a9144e52d694 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:01.525572 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 614/1213] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:01.531902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7542e-8b06-4caa-ac4a-92dc3d4778d3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.542159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7542e-8b06-4caa-ac4a-92dc3d4778d3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.546811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe640b-a47b-47de-bd51-b7209b2cf3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.547931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe640b-a47b-47de-bd51-b7209b2cf3da admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.547931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe640b-a47b-47de-bd51-b7209b2cf3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.548104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe640b-a47b-47de-bd51-b7209b2cf3da admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.548710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe640b-a47b-47de-bd51-b7209b2cf3da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:01.549040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe640b-a47b-47de-bd51-b7209b2cf3da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:01.550632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe640b-a47b-47de-bd51-b7209b2cf3da admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:01.563069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 600/1214] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:01.569438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d818f8a-ff88-478c-8153-a9144e52d694 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.580158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d818f8a-ff88-478c-8153-a9144e52d694 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.584886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dadbef-679b-49c0-b886-1998cbb030bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.585679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dadbef-679b-49c0-b886-1998cbb030bc admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.586006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dadbef-679b-49c0-b886-1998cbb030bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.586296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dadbef-679b-49c0-b886-1998cbb030bc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.593983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dadbef-679b-49c0-b886-1998cbb030bc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:01.595945 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dadbef-679b-49c0-b886-1998cbb030bc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:01.609397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-d4dadbef-679b-49c0-b886-1998cbb030bc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:27:01.610797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 615/1215] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:27:01.617378 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe640b-a47b-47de-bd51-b7209b2cf3da admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.627620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe640b-a47b-47de-bd51-b7209b2cf3da admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.632244 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55a86d-5922-4164-973c-12d580090850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.633123 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55a86d-5922-4164-973c-12d580090850 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.633402 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55a86d-5922-4164-973c-12d580090850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.633671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55a86d-5922-4164-973c-12d580090850 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.634508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55a86d-5922-4164-973c-12d580090850 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:01.634813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55a86d-5922-4164-973c-12d580090850 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:01.636740 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55a86d-5922-4164-973c-12d580090850 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:01.650037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 601/1216] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:27:01.657834 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dadbef-679b-49c0-b886-1998cbb030bc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:01.669578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dadbef-679b-49c0-b886-1998cbb030bc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:01.675079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804aee0-17a7-4e61-93a2-c786d08a0341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:01.675767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804aee0-17a7-4e61-93a2-c786d08a0341 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:01.676041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804aee0-17a7-4e61-93a2-c786d08a0341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:01.676455 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804aee0-17a7-4e61-93a2-c786d08a0341 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:01.677353 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804aee0-17a7-4e61-93a2-c786d08a0341 admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=797b1d42ac3a427bb084740a069b577d) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:01.677645 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804aee0-17a7-4e61-93a2-c786d08a0341 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:01.679625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804aee0-17a7-4e61-93a2-c786d08a0341 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:01.685608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 616/1217] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:27:01 2021] GET /identity/v3/role_assignments?user.id=797b1d42ac3a427bb084740a069b577d&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:04.271738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299a61-2149-46fa-aca5-5d3732261aab None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.271738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299a61-2149-46fa-aca5-5d3732261aab None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.274857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299a61-2149-46fa-aca5-5d3732261aab None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.274857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 602/1218] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:27:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:27:04.281044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bcb88-b1dd-41d0-af6f-1a4396ae06f5 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.281494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bcb88-b1dd-41d0-af6f-1a4396ae06f5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.281624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bcb88-b1dd-41d0-af6f-1a4396ae06f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.304176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-031bcb88-b1dd-41d0-af6f-1a4396ae06f5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:04.305362 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-031bcb88-b1dd-41d0-af6f-1a4396ae06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:04.315637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 617/1219] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:27:04 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:27:04.345301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299a61-2149-46fa-aca5-5d3732261aab None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:04.359815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299a61-2149-46fa-aca5-5d3732261aab None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:04.365357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3e0da-f082-4a66-9324-8122c60531f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:04.366222 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e0da-f082-4a66-9324-8122c60531f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.366507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e0da-f082-4a66-9324-8122c60531f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.366811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e0da-f082-4a66-9324-8122c60531f6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.380634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3e0da-f082-4a66-9324-8122c60531f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:27:04.387713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-a9a3e0da-f082-4a66-9324-8122c60531f6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:27:04.388917 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 603/1220] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:27:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:04.395859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bcb88-b1dd-41d0-af6f-1a4396ae06f5 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:04.405104 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bcb88-b1dd-41d0-af6f-1a4396ae06f5 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:04.409821 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598511e-47bc-4fa1-86b4-34acb5a0dff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:04.410634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598511e-47bc-4fa1-86b4-34acb5a0dff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.411046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598511e-47bc-4fa1-86b4-34acb5a0dff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.411517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598511e-47bc-4fa1-86b4-34acb5a0dff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.412556 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598511e-47bc-4fa1-86b4-34acb5a0dff6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:04.413175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598511e-47bc-4fa1-86b4-34acb5a0dff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:04.415798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598511e-47bc-4fa1-86b4-34acb5a0dff6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:04.427647 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 618/1221] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:27:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:04.434697 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3e0da-f082-4a66-9324-8122c60531f6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:04.457559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3e0da-f082-4a66-9324-8122c60531f6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:04.462456 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73a947-3942-424e-a91a-f9464976d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:04.463236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73a947-3942-424e-a91a-f9464976d0dc admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.463512 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73a947-3942-424e-a91a-f9464976d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.463783 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73a947-3942-424e-a91a-f9464976d0dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.475502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73a947-3942-424e-a91a-f9464976d0dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:04.477536 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73a947-3942-424e-a91a-f9464976d0dc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:04.497111 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-1c73a947-3942-424e-a91a-f9464976d0dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:04.498353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 604/1222] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:27:04.506278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598511e-47bc-4fa1-86b4-34acb5a0dff6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:04.519165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598511e-47bc-4fa1-86b4-34acb5a0dff6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:04.524287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147c636-ccd7-4478-a89d-4d69cc553a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:04.525057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147c636-ccd7-4478-a89d-4d69cc553a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.525375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147c636-ccd7-4478-a89d-4d69cc553a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.525655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147c636-ccd7-4478-a89d-4d69cc553a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.526475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147c636-ccd7-4478-a89d-4d69cc553a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:04.526828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147c636-ccd7-4478-a89d-4d69cc553a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:04.529052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147c636-ccd7-4478-a89d-4d69cc553a7b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:04.542742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 619/1223] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:04.549874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73a947-3942-424e-a91a-f9464976d0dc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:04.562239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73a947-3942-424e-a91a-f9464976d0dc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:04.569744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1be05-00e6-48c0-a23d-a4f46c0f7227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:04.570654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1be05-00e6-48c0-a23d-a4f46c0f7227 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.570945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1be05-00e6-48c0-a23d-a4f46c0f7227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.571201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1be05-00e6-48c0-a23d-a4f46c0f7227 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.579369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1be05-00e6-48c0-a23d-a4f46c0f7227 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:04.581548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1be05-00e6-48c0-a23d-a4f46c0f7227 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:04.598817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-73d1be05-00e6-48c0-a23d-a4f46c0f7227 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:27:04.600129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 605/1224] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:04.606981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147c636-ccd7-4478-a89d-4d69cc553a7b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:04.618555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147c636-ccd7-4478-a89d-4d69cc553a7b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:04.623860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb66e6f-aff8-4bbc-87be-aa194bc83483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:04.624525 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb66e6f-aff8-4bbc-87be-aa194bc83483 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.624914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb66e6f-aff8-4bbc-87be-aa194bc83483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.625319 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb66e6f-aff8-4bbc-87be-aa194bc83483 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.626677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb66e6f-aff8-4bbc-87be-aa194bc83483 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:04.626677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb66e6f-aff8-4bbc-87be-aa194bc83483 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:04.629800 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb66e6f-aff8-4bbc-87be-aa194bc83483 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:04.648185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 620/1225] 10.222.0.83 () {56 vars in 1164 bytes} [Wed Dec 15 13:27:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:04.654897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1be05-00e6-48c0-a23d-a4f46c0f7227 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:04.665442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1be05-00e6-48c0-a23d-a4f46c0f7227 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:04.671234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceec23-78b8-449e-8939-7110a01990de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:04.672396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceec23-78b8-449e-8939-7110a01990de admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.672825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceec23-78b8-449e-8939-7110a01990de admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.673264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceec23-78b8-449e-8939-7110a01990de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.685534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dceec23-78b8-449e-8939-7110a01990de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:04.687497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dceec23-78b8-449e-8939-7110a01990de admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:04.706400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-4dceec23-78b8-449e-8939-7110a01990de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:04.716245 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 606/1226] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:04.717358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb66e6f-aff8-4bbc-87be-aa194bc83483 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:04.734886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb66e6f-aff8-4bbc-87be-aa194bc83483 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:04.740569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f62237-0dca-4a6f-abf3-1c63443a9341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:04.741244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62237-0dca-4a6f-abf3-1c63443a9341 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.741562 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62237-0dca-4a6f-abf3-1c63443a9341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.741930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62237-0dca-4a6f-abf3-1c63443a9341 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.742664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f62237-0dca-4a6f-abf3-1c63443a9341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:04.742965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f62237-0dca-4a6f-abf3-1c63443a9341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:04.744541 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f62237-0dca-4a6f-abf3-1c63443a9341 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:04.756355 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 621/1227] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:04.762669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceec23-78b8-449e-8939-7110a01990de admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:04.774641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceec23-78b8-449e-8939-7110a01990de admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:04.781099 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b023-9ba6-41b9-9d84-76e8ee0a15dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:04.782041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b023-9ba6-41b9-9d84-76e8ee0a15dc admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.782325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b023-9ba6-41b9-9d84-76e8ee0a15dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.782591 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b023-9ba6-41b9-9d84-76e8ee0a15dc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.791492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b023-9ba6-41b9-9d84-76e8ee0a15dc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:04.794462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b023-9ba6-41b9-9d84-76e8ee0a15dc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:04.810672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-5387b023-9ba6-41b9-9d84-76e8ee0a15dc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:27:04.812310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 607/1228] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:27:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:04.819925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f62237-0dca-4a6f-abf3-1c63443a9341 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:04.832946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f62237-0dca-4a6f-abf3-1c63443a9341 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:04.841085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d6ad2-498d-480a-98e9-0b367c12da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:04.841781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d6ad2-498d-480a-98e9-0b367c12da66 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.842054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d6ad2-498d-480a-98e9-0b367c12da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.842331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d6ad2-498d-480a-98e9-0b367c12da66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.843129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d6ad2-498d-480a-98e9-0b367c12da66 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:04.843447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d6ad2-498d-480a-98e9-0b367c12da66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:04.845274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d6ad2-498d-480a-98e9-0b367c12da66 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:04.859389 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 622/1229] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:27:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:27:04.865973 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b023-9ba6-41b9-9d84-76e8ee0a15dc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:04.877160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b023-9ba6-41b9-9d84-76e8ee0a15dc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:04.881843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685197d-b6d0-42bb-ac29-3af1274f5660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:04.882729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685197d-b6d0-42bb-ac29-3af1274f5660 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:04.883003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685197d-b6d0-42bb-ac29-3af1274f5660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:04.883271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685197d-b6d0-42bb-ac29-3af1274f5660 admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/797b1d42ac3a427bb084740a069b577d/roles/35803c6179744bf1933e2b30b362f87d` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:04.898845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685197d-b6d0-42bb-ac29-3af1274f5660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=797b1d42ac3a427bb084740a069b577d, role_id=35803c6179744bf1933e2b30b362f87d)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:04.901467 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685197d-b6d0-42bb-ac29-3af1274f5660 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:04.915161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 608/1230] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:27:04 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/797b1d42ac3a427bb084740a069b577d/roles/35803c6179744bf1933e2b30b362f87d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:27:07.510773 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa90d-bdd9-4b39-989c-06b41670a4bd None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:07.511339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa90d-bdd9-4b39-989c-06b41670a4bd None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:07.511339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa90d-bdd9-4b39-989c-06b41670a4bd None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:07.513148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 623/1231] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:27:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:27:07.519864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50550e-e2ea-4ebe-9de1-ff6dc242fa7f None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:07.523974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50550e-e2ea-4ebe-9de1-ff6dc242fa7f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:07.523974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50550e-e2ea-4ebe-9de1-ff6dc242fa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:07.538873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-cb50550e-e2ea-4ebe-9de1-ff6dc242fa7f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:07.540055 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-cb50550e-e2ea-4ebe-9de1-ff6dc242fa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:07.598298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 609/1232] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:27:07 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:27:07.625495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daa90d-bdd9-4b39-989c-06b41670a4bd None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:07.642668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daa90d-bdd9-4b39-989c-06b41670a4bd None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:07.647919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae01697-d98c-422c-bbcc-a1d9b4186f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:07.648870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae01697-d98c-422c-bbcc-a1d9b4186f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:07.649204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae01697-d98c-422c-bbcc-a1d9b4186f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:07.649643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae01697-d98c-422c-bbcc-a1d9b4186f9d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:07.666274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae01697-d98c-422c-bbcc-a1d9b4186f9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:27:07.674418 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-dae01697-d98c-422c-bbcc-a1d9b4186f9d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 13:27:07.675645 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 624/1233] 10.222.0.83 () {56 vars in 1123 bytes} [Wed Dec 15 13:27:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:07.682780 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50550e-e2ea-4ebe-9de1-ff6dc242fa7f None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:07.692505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50550e-e2ea-4ebe-9de1-ff6dc242fa7f None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:07.698012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b18ad-4ec6-4c75-b1f9-79830fc9f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:07.698673 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b18ad-4ec6-4c75-b1f9-79830fc9f642 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:07.698954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b18ad-4ec6-4c75-b1f9-79830fc9f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:07.699266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b18ad-4ec6-4c75-b1f9-79830fc9f642 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:07.700029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b18ad-4ec6-4c75-b1f9-79830fc9f642 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:07.700335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b18ad-4ec6-4c75-b1f9-79830fc9f642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:07.702078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b18ad-4ec6-4c75-b1f9-79830fc9f642 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:07.710750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 610/1234] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Dec 15 13:27:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:07.720313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae01697-d98c-422c-bbcc-a1d9b4186f9d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:07.731607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae01697-d98c-422c-bbcc-a1d9b4186f9d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:07.736428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf251d3f-42ee-4ef7-bbbd-ef6c2ec6d5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:07.737213 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf251d3f-42ee-4ef7-bbbd-ef6c2ec6d5bc admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:07.737489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf251d3f-42ee-4ef7-bbbd-ef6c2ec6d5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:07.737808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf251d3f-42ee-4ef7-bbbd-ef6c2ec6d5bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:07.750374 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf251d3f-42ee-4ef7-bbbd-ef6c2ec6d5bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:07.752380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf251d3f-42ee-4ef7-bbbd-ef6c2ec6d5bc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:07.773159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-cf251d3f-42ee-4ef7-bbbd-ef6c2ec6d5bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:07.774459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 625/1235] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:07.782043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b18ad-4ec6-4c75-b1f9-79830fc9f642 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:07.792052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b18ad-4ec6-4c75-b1f9-79830fc9f642 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:07.797354 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755996c1-c5a6-47f8-827f-c246d3ed914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:07.798089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755996c1-c5a6-47f8-827f-c246d3ed914c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:07.798325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755996c1-c5a6-47f8-827f-c246d3ed914c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:07.798600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755996c1-c5a6-47f8-827f-c246d3ed914c admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:07.799467 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755996c1-c5a6-47f8-827f-c246d3ed914c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:07.799748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755996c1-c5a6-47f8-827f-c246d3ed914c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:07.801450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755996c1-c5a6-47f8-827f-c246d3ed914c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:07.818558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 611/1236] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:27:07.824805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf251d3f-42ee-4ef7-bbbd-ef6c2ec6d5bc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:07.834940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf251d3f-42ee-4ef7-bbbd-ef6c2ec6d5bc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:07.839763 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3a92f-1c08-419f-912d-2d44577a6797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:07.841403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3a92f-1c08-419f-912d-2d44577a6797 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:07.841613 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3a92f-1c08-419f-912d-2d44577a6797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:07.842039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3a92f-1c08-419f-912d-2d44577a6797 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:07.851379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3a92f-1c08-419f-912d-2d44577a6797 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:07.853548 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3a92f-1c08-419f-912d-2d44577a6797 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:07.869951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-14b3a92f-1c08-419f-912d-2d44577a6797 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:27:07.871233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 626/1237] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:07 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:07.877906 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755996c1-c5a6-47f8-827f-c246d3ed914c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:07.889064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755996c1-c5a6-47f8-827f-c246d3ed914c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:07.895892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48638580-c710-4664-8f7c-35de718ae48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:07.896910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48638580-c710-4664-8f7c-35de718ae48f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:07.897213 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48638580-c710-4664-8f7c-35de718ae48f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:07.897489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48638580-c710-4664-8f7c-35de718ae48f admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:07.898501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48638580-c710-4664-8f7c-35de718ae48f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:07.898798 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48638580-c710-4664-8f7c-35de718ae48f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:07.900866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48638580-c710-4664-8f7c-35de718ae48f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:07.920965 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 612/1238] 10.222.0.83 () {56 vars in 1164 bytes} [Wed Dec 15 13:27:07 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:07.928032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3a92f-1c08-419f-912d-2d44577a6797 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:07.938817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3a92f-1c08-419f-912d-2d44577a6797 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:07.944186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3edba-e062-4c5c-a9ec-f86ad4a9fba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:07.945037 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3edba-e062-4c5c-a9ec-f86ad4a9fba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:07.945400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3edba-e062-4c5c-a9ec-f86ad4a9fba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:07.945777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3edba-e062-4c5c-a9ec-f86ad4a9fba8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:07.954895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3edba-e062-4c5c-a9ec-f86ad4a9fba8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:07.956842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3edba-e062-4c5c-a9ec-f86ad4a9fba8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:07.969222 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 627/1239] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:27:07 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:27:07.978299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48638580-c710-4664-8f7c-35de718ae48f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:07.993354 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48638580-c710-4664-8f7c-35de718ae48f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:08.000721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4564da5-c5ae-4f7f-8913-f5981c5f6151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:08.002124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4564da5-c5ae-4f7f-8913-f5981c5f6151 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:08.002528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4564da5-c5ae-4f7f-8913-f5981c5f6151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:08.003002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4564da5-c5ae-4f7f-8913-f5981c5f6151 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:08.020684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4564da5-c5ae-4f7f-8913-f5981c5f6151 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:08.022183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4564da5-c5ae-4f7f-8913-f5981c5f6151 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:08.042426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-e4564da5-c5ae-4f7f-8913-f5981c5f6151 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:08.043042 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 613/1240] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:08.050581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3edba-e062-4c5c-a9ec-f86ad4a9fba8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:08.063946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3edba-e062-4c5c-a9ec-f86ad4a9fba8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:08.069004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8aa18-af48-466d-a8bb-4f5494de2630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:08.069732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8aa18-af48-466d-a8bb-4f5494de2630 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:08.070110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8aa18-af48-466d-a8bb-4f5494de2630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:08.070391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8aa18-af48-466d-a8bb-4f5494de2630 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:08.071122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8aa18-af48-466d-a8bb-4f5494de2630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:08.071426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8aa18-af48-466d-a8bb-4f5494de2630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:08.072991 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8aa18-af48-466d-a8bb-4f5494de2630 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:08.084899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 628/1241] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:08.092755 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4564da5-c5ae-4f7f-8913-f5981c5f6151 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:08.102645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4564da5-c5ae-4f7f-8913-f5981c5f6151 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:08.107578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edf1c9-9408-400d-9008-51e1c48809d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:08.108435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edf1c9-9408-400d-9008-51e1c48809d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:08.108779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edf1c9-9408-400d-9008-51e1c48809d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:08.109077 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edf1c9-9408-400d-9008-51e1c48809d4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:08.116198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edf1c9-9408-400d-9008-51e1c48809d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:08.118176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edf1c9-9408-400d-9008-51e1c48809d4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:08.131788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-39edf1c9-9408-400d-9008-51e1c48809d4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:27:08.133049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 614/1242] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:27:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:08.140375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8aa18-af48-466d-a8bb-4f5494de2630 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:08.151428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8aa18-af48-466d-a8bb-4f5494de2630 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:08.156522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b5828-7353-43d2-900e-6f7e407c73e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:08.157171 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b5828-7353-43d2-900e-6f7e407c73e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:08.157452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b5828-7353-43d2-900e-6f7e407c73e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:08.157727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b5828-7353-43d2-900e-6f7e407c73e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:08.158543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b5828-7353-43d2-900e-6f7e407c73e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:08.158851 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b5828-7353-43d2-900e-6f7e407c73e6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:08.160671 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b5828-7353-43d2-900e-6f7e407c73e6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:08.173547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 629/1243] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:27:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:08.180707 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edf1c9-9408-400d-9008-51e1c48809d4 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:08.192618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edf1c9-9408-400d-9008-51e1c48809d4 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:08.197900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9f0b-1ccb-44f6-9937-140c5685cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:08.198543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9f0b-1ccb-44f6-9937-140c5685cd1b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:08.198956 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9f0b-1ccb-44f6-9937-140c5685cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:08.199899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9f0b-1ccb-44f6-9937-140c5685cd1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:08.201514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9f0b-1ccb-44f6-9937-140c5685cd1b admin admin] RBAC: Adding query filter params (role.id=35803c6179744bf1933e2b30b362f87d, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=797b1d42ac3a427bb084740a069b577d) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:08.201857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9f0b-1ccb-44f6-9937-140c5685cd1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:08.204132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9f0b-1ccb-44f6-9937-140c5685cd1b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:08.211232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 615/1244] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:27:08 2021] GET /identity/v3/role_assignments?user.id=797b1d42ac3a427bb084740a069b577d&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=35803c6179744bf1933e2b30b362f87d => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:10.876472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764d931-53b8-4040-98d9-283dc35c4c5a None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:10.877093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764d931-53b8-4040-98d9-283dc35c4c5a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:10.877093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764d931-53b8-4040-98d9-283dc35c4c5a None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:10.879107 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 630/1245] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:27:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:27:10.885197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677087-d2f3-438f-9a74-37adc717f16e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:10.885658 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677087-d2f3-438f-9a74-37adc717f16e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:10.885803 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677087-d2f3-438f-9a74-37adc717f16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:10.906632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f6677087-d2f3-438f-9a74-37adc717f16e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:10.909076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f6677087-d2f3-438f-9a74-37adc717f16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:10.917044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 616/1246] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:27:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:27:10.941371 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764d931-53b8-4040-98d9-283dc35c4c5a None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:10.955938 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764d931-53b8-4040-98d9-283dc35c4c5a None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:10.961354 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e3ab0-09b7-4655-9359-caf2b5581a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:10.962188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e3ab0-09b7-4655-9359-caf2b5581a5e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:10.962470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e3ab0-09b7-4655-9359-caf2b5581a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:10.962882 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e3ab0-09b7-4655-9359-caf2b5581a5e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:10.976832 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e3ab0-09b7-4655-9359-caf2b5581a5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:27:10.984787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-a98e3ab0-09b7-4655-9359-caf2b5581a5e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:27:10.986249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 631/1247] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:27:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:10.992888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6677087-d2f3-438f-9a74-37adc717f16e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:11.001967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6677087-d2f3-438f-9a74-37adc717f16e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:11.006599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29700e3a-3e1f-4bd6-a14c-43c3f5522e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:11.007255 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700e3a-3e1f-4bd6-a14c-43c3f5522e43 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:11.007559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700e3a-3e1f-4bd6-a14c-43c3f5522e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:11.007803 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700e3a-3e1f-4bd6-a14c-43c3f5522e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:11.008554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29700e3a-3e1f-4bd6-a14c-43c3f5522e43 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:11.008850 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29700e3a-3e1f-4bd6-a14c-43c3f5522e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:11.010510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29700e3a-3e1f-4bd6-a14c-43c3f5522e43 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:11.019540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 617/1248] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:27:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:11.025942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e3ab0-09b7-4655-9359-caf2b5581a5e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:11.036823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e3ab0-09b7-4655-9359-caf2b5581a5e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:11.041963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cf197-0a82-4bb1-b906-1db54844e40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:11.042740 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cf197-0a82-4bb1-b906-1db54844e40b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:11.043018 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cf197-0a82-4bb1-b906-1db54844e40b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:11.043289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cf197-0a82-4bb1-b906-1db54844e40b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:11.054659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cf197-0a82-4bb1-b906-1db54844e40b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:11.056485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cf197-0a82-4bb1-b906-1db54844e40b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:11.075041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-1b9cf197-0a82-4bb1-b906-1db54844e40b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:11.076311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 632/1249] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:11.082715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29700e3a-3e1f-4bd6-a14c-43c3f5522e43 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:11.093223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29700e3a-3e1f-4bd6-a14c-43c3f5522e43 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:11.098910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e84089-d706-4e19-af55-48c32d8754fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:11.099952 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84089-d706-4e19-af55-48c32d8754fc admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:11.100384 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84089-d706-4e19-af55-48c32d8754fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:11.100854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84089-d706-4e19-af55-48c32d8754fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:11.102110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e84089-d706-4e19-af55-48c32d8754fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:11.102707 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e84089-d706-4e19-af55-48c32d8754fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:11.104997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e84089-d706-4e19-af55-48c32d8754fc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:11.124084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 618/1250] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:11.130605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cf197-0a82-4bb1-b906-1db54844e40b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:11.142962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cf197-0a82-4bb1-b906-1db54844e40b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:11.149427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b56264-3c83-405b-b59e-ba93a9bcba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:11.150650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b56264-3c83-405b-b59e-ba93a9bcba50 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:11.151956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b56264-3c83-405b-b59e-ba93a9bcba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:11.152425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b56264-3c83-405b-b59e-ba93a9bcba50 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:11.163497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b56264-3c83-405b-b59e-ba93a9bcba50 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:11.166088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b56264-3c83-405b-b59e-ba93a9bcba50 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:11.188307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-a7b56264-3c83-405b-b59e-ba93a9bcba50 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:27:11.190216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 633/1251] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:11 2021] GET /identity/v3/users/placement => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:27:11.197297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e84089-d706-4e19-af55-48c32d8754fc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:11.207999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e84089-d706-4e19-af55-48c32d8754fc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:11.212672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896701e-54e1-44ac-b1a2-242dc023fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:11.213322 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896701e-54e1-44ac-b1a2-242dc023fac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:11.213597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896701e-54e1-44ac-b1a2-242dc023fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:11.213895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896701e-54e1-44ac-b1a2-242dc023fac0 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:11.214735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896701e-54e1-44ac-b1a2-242dc023fac0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:11.215089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896701e-54e1-44ac-b1a2-242dc023fac0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:11.217423 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896701e-54e1-44ac-b1a2-242dc023fac0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:11.236162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 619/1252] 10.222.0.83 () {56 vars in 1164 bytes} [Wed Dec 15 13:27:11 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:11.244479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b56264-3c83-405b-b59e-ba93a9bcba50 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:11.255482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b56264-3c83-405b-b59e-ba93a9bcba50 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:11.260876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e2f2e-21e6-43c7-8d7e-3a97cc9df2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:11.261514 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e2f2e-21e6-43c7-8d7e-3a97cc9df2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:11.261873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e2f2e-21e6-43c7-8d7e-3a97cc9df2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:11.262718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e2f2e-21e6-43c7-8d7e-3a97cc9df2d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:11.273397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e2f2e-21e6-43c7-8d7e-3a97cc9df2d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:11.276779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e2f2e-21e6-43c7-8d7e-3a97cc9df2d9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:11.293973 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 634/1253] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:27:11 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:27:11.295241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896701e-54e1-44ac-b1a2-242dc023fac0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:11.306757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896701e-54e1-44ac-b1a2-242dc023fac0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:11.312651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd8800-011b-4cde-a88b-3548acd8b12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:11.313532 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd8800-011b-4cde-a88b-3548acd8b12c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:11.313902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd8800-011b-4cde-a88b-3548acd8b12c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:11.314236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd8800-011b-4cde-a88b-3548acd8b12c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:11.328060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd8800-011b-4cde-a88b-3548acd8b12c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:11.330192 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd8800-011b-4cde-a88b-3548acd8b12c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:11.348244 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-4ffd8800-011b-4cde-a88b-3548acd8b12c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:11.349595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 620/1254] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:27:11.357024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e2f2e-21e6-43c7-8d7e-3a97cc9df2d9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:11.367039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e2f2e-21e6-43c7-8d7e-3a97cc9df2d9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:11.372980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c801aed-18e2-4517-8d60-c2bcfe4aa57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:11.373637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c801aed-18e2-4517-8d60-c2bcfe4aa57c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:11.373965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c801aed-18e2-4517-8d60-c2bcfe4aa57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:11.374271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c801aed-18e2-4517-8d60-c2bcfe4aa57c admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:11.374936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c801aed-18e2-4517-8d60-c2bcfe4aa57c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:11.375256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c801aed-18e2-4517-8d60-c2bcfe4aa57c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:11.376803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c801aed-18e2-4517-8d60-c2bcfe4aa57c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:11.393790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 635/1255] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:27:11.396802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd8800-011b-4cde-a88b-3548acd8b12c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:11.407341 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd8800-011b-4cde-a88b-3548acd8b12c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:11.412969 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aea849-5165-4dca-a0bb-813da7237050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:11.413945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aea849-5165-4dca-a0bb-813da7237050 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:11.414173 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aea849-5165-4dca-a0bb-813da7237050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:11.414446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aea849-5165-4dca-a0bb-813da7237050 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:11.422190 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aea849-5165-4dca-a0bb-813da7237050 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:11.424129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aea849-5165-4dca-a0bb-813da7237050 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:11.441459 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-30aea849-5165-4dca-a0bb-813da7237050 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:27:11.443080 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 621/1256] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:27:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:11.451583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c801aed-18e2-4517-8d60-c2bcfe4aa57c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:11.463922 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c801aed-18e2-4517-8d60-c2bcfe4aa57c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:11.469163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0e97c-30a2-42dc-9fa0-051ea36f2336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:11.469844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e97c-30a2-42dc-9fa0-051ea36f2336 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:11.470128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e97c-30a2-42dc-9fa0-051ea36f2336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:11.470393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e97c-30a2-42dc-9fa0-051ea36f2336 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:11.471502 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0e97c-30a2-42dc-9fa0-051ea36f2336 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:11.471795 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0e97c-30a2-42dc-9fa0-051ea36f2336 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:11.473606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0e97c-30a2-42dc-9fa0-051ea36f2336 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:11.486554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 636/1257] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:27:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:11.494545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aea849-5165-4dca-a0bb-813da7237050 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:11.507907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aea849-5165-4dca-a0bb-813da7237050 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:11.513918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37727f40-18ef-4e2d-b6b5-1c9bfe275edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:11.514577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727f40-18ef-4e2d-b6b5-1c9bfe275edd admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:11.514857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727f40-18ef-4e2d-b6b5-1c9bfe275edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:11.515130 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727f40-18ef-4e2d-b6b5-1c9bfe275edd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:11.515984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37727f40-18ef-4e2d-b6b5-1c9bfe275edd admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=797b1d42ac3a427bb084740a069b577d) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:11.516296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37727f40-18ef-4e2d-b6b5-1c9bfe275edd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:11.518173 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37727f40-18ef-4e2d-b6b5-1c9bfe275edd admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:11.524862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 622/1258] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:27:11 2021] GET /identity/v3/role_assignments?user.id=797b1d42ac3a427bb084740a069b577d&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=a312b345efeb490eb4234d1ace386dec => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:13.881688 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6e45-f38c-4b70-9600-2af69894bf4a None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:13.882297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6e45-f38c-4b70-9600-2af69894bf4a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:13.882380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6e45-f38c-4b70-9600-2af69894bf4a None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:13.884208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 637/1259] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:27:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:27:13.891067 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9208-18ef-4911-8a57-72589dab3c74 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:13.891562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9208-18ef-4911-8a57-72589dab3c74 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:13.891649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9208-18ef-4911-8a57-72589dab3c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:13.910907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-123d9208-18ef-4911-8a57-72589dab3c74 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:13.912185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-123d9208-18ef-4911-8a57-72589dab3c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:13.921010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 623/1260] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:27:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:27:13.946179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c6e45-f38c-4b70-9600-2af69894bf4a None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:13.964536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c6e45-f38c-4b70-9600-2af69894bf4a None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:13.971816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d2fe1-2c69-4aa4-83de-46313eaea486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:13.972710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2fe1-2c69-4aa4-83de-46313eaea486 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:13.972992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2fe1-2c69-4aa4-83de-46313eaea486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:13.973272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2fe1-2c69-4aa4-83de-46313eaea486 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:13.985174 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d2fe1-2c69-4aa4-83de-46313eaea486 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:27:13.992513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-939d2fe1-2c69-4aa4-83de-46313eaea486 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:27:13.993995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 638/1261] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:27:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:14.000932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d9208-18ef-4911-8a57-72589dab3c74 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:14.010612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d9208-18ef-4911-8a57-72589dab3c74 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:14.016315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8622c-92fe-48e0-870a-40b73c7301ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:14.017074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8622c-92fe-48e0-870a-40b73c7301ee admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:14.017352 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8622c-92fe-48e0-870a-40b73c7301ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:14.017650 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8622c-92fe-48e0-870a-40b73c7301ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:14.018494 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8622c-92fe-48e0-870a-40b73c7301ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:14.018870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8622c-92fe-48e0-870a-40b73c7301ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:14.020525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8622c-92fe-48e0-870a-40b73c7301ee admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:14.032262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 624/1262] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:27:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:14.038907 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d2fe1-2c69-4aa4-83de-46313eaea486 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:14.052054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d2fe1-2c69-4aa4-83de-46313eaea486 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:14.059398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e5449-f632-431f-bcfa-4e4c12012fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:14.060231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e5449-f632-431f-bcfa-4e4c12012fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:14.060654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e5449-f632-431f-bcfa-4e4c12012fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:14.060944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e5449-f632-431f-bcfa-4e4c12012fe6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:14.075309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e5449-f632-431f-bcfa-4e4c12012fe6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:14.078783 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e5449-f632-431f-bcfa-4e4c12012fe6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:14.102321 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-5b7e5449-f632-431f-bcfa-4e4c12012fe6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:14.104030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 639/1263] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:14.112070 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8622c-92fe-48e0-870a-40b73c7301ee admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:14.126582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8622c-92fe-48e0-870a-40b73c7301ee admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:14.133108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3b241-8bc3-41da-bb53-8ee09fb04b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:14.133908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3b241-8bc3-41da-bb53-8ee09fb04b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:14.134235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3b241-8bc3-41da-bb53-8ee09fb04b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:14.134516 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3b241-8bc3-41da-bb53-8ee09fb04b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:14.135260 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3b241-8bc3-41da-bb53-8ee09fb04b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:14.135568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3b241-8bc3-41da-bb53-8ee09fb04b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:14.137694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3b241-8bc3-41da-bb53-8ee09fb04b9c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:14.153964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 625/1264] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:14.160510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e5449-f632-431f-bcfa-4e4c12012fe6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:14.171761 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e5449-f632-431f-bcfa-4e4c12012fe6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:14.177289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ec766-b7ef-4a81-a147-fd78a30a53af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:14.178508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ec766-b7ef-4a81-a147-fd78a30a53af admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:14.179010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ec766-b7ef-4a81-a147-fd78a30a53af admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:14.179010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ec766-b7ef-4a81-a147-fd78a30a53af admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:14.189188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ec766-b7ef-4a81-a147-fd78a30a53af admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:14.191383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ec766-b7ef-4a81-a147-fd78a30a53af admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:14.207508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-528ec766-b7ef-4a81-a147-fd78a30a53af admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:27:14.208866 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 640/1265] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:14 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:27:14.216009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3b241-8bc3-41da-bb53-8ee09fb04b9c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:14.230660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3b241-8bc3-41da-bb53-8ee09fb04b9c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:14.239940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5476-fbab-403b-870a-5a6c8e0d1083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:14.241077 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5476-fbab-403b-870a-5a6c8e0d1083 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:14.241439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5476-fbab-403b-870a-5a6c8e0d1083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:14.241720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5476-fbab-403b-870a-5a6c8e0d1083 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:14.243113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be5476-fbab-403b-870a-5a6c8e0d1083 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:14.243507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be5476-fbab-403b-870a-5a6c8e0d1083 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:14.245877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be5476-fbab-403b-870a-5a6c8e0d1083 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:14.269364 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 626/1266] 10.222.0.83 () {56 vars in 1164 bytes} [Wed Dec 15 13:27:14 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:14.275893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ec766-b7ef-4a81-a147-fd78a30a53af admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:14.289421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ec766-b7ef-4a81-a147-fd78a30a53af admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:14.295831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8374a-8278-45be-b855-b3a301f1f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:14.297952 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8374a-8278-45be-b855-b3a301f1f16c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:14.298285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8374a-8278-45be-b855-b3a301f1f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:14.298585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8374a-8278-45be-b855-b3a301f1f16c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:14.313717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8374a-8278-45be-b855-b3a301f1f16c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:14.315964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8374a-8278-45be-b855-b3a301f1f16c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:14.335243 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-03c8374a-8278-45be-b855-b3a301f1f16c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:14.336527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 641/1267] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:14.343202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5476-fbab-403b-870a-5a6c8e0d1083 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:14.353927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5476-fbab-403b-870a-5a6c8e0d1083 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:14.359564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674db11a-e9db-4f3f-8aba-ad0c528a81e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:14.360283 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674db11a-e9db-4f3f-8aba-ad0c528a81e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:14.360615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674db11a-e9db-4f3f-8aba-ad0c528a81e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:14.360886 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674db11a-e9db-4f3f-8aba-ad0c528a81e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:14.361647 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674db11a-e9db-4f3f-8aba-ad0c528a81e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:14.361985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674db11a-e9db-4f3f-8aba-ad0c528a81e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:14.363797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674db11a-e9db-4f3f-8aba-ad0c528a81e7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:14.377428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 627/1268] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:27:14.384005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8374a-8278-45be-b855-b3a301f1f16c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:14.394678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8374a-8278-45be-b855-b3a301f1f16c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:14.400896 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51758cbe-f2b9-4be6-85ed-d7ff98b9de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:14.401876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51758cbe-f2b9-4be6-85ed-d7ff98b9de76 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:14.402211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51758cbe-f2b9-4be6-85ed-d7ff98b9de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:14.402438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51758cbe-f2b9-4be6-85ed-d7ff98b9de76 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:14.412534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51758cbe-f2b9-4be6-85ed-d7ff98b9de76 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:14.414533 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51758cbe-f2b9-4be6-85ed-d7ff98b9de76 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:14.431129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-51758cbe-f2b9-4be6-85ed-d7ff98b9de76 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:27:14.432645 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 642/1269] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:27:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:14.439673 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674db11a-e9db-4f3f-8aba-ad0c528a81e7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:14.451638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674db11a-e9db-4f3f-8aba-ad0c528a81e7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:14.457247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2b95e-2743-4391-b374-353255f74a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:14.458342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b95e-2743-4391-b374-353255f74a57 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:14.458342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b95e-2743-4391-b374-353255f74a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:14.458655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b95e-2743-4391-b374-353255f74a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:14.459463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2b95e-2743-4391-b374-353255f74a57 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:14.459805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2b95e-2743-4391-b374-353255f74a57 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:14.461653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2b95e-2743-4391-b374-353255f74a57 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:14.481585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 628/1270] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:27:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:14.482889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51758cbe-f2b9-4be6-85ed-d7ff98b9de76 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:14.494268 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51758cbe-f2b9-4be6-85ed-d7ff98b9de76 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:14.500034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1454734-6669-4265-b8e5-522886c103a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:14.500925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1454734-6669-4265-b8e5-522886c103a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:14.501214 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1454734-6669-4265-b8e5-522886c103a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:14.501458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1454734-6669-4265-b8e5-522886c103a0 admin admin] PATH_INFO: `/v3/projects/3be4b5e724284f998093583529d1723e/users/797b1d42ac3a427bb084740a069b577d/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:14.503790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1454734-6669-4265-b8e5-522886c103a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be4b5e724284f998093583529d1723e, user_id=797b1d42ac3a427bb084740a069b577d, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:14.506836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1454734-6669-4265-b8e5-522886c103a0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:14.521499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 643/1271] 10.222.0.83 () {58 vars in 1460 bytes} [Wed Dec 15 13:27:14 2021] PUT /identity/v3/projects/3be4b5e724284f998093583529d1723e/users/797b1d42ac3a427bb084740a069b577d/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:27:17.028617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f23775-ec90-4cf2-ba36-b30f2b7c9c58 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.029125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f23775-ec90-4cf2-ba36-b30f2b7c9c58 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.029125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f23775-ec90-4cf2-ba36-b30f2b7c9c58 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.033067 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 629/1272] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:27:17 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:27:17.038936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50000707-7a3d-4f94-b6ac-6ee4dd57fb97 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.039396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50000707-7a3d-4f94-b6ac-6ee4dd57fb97 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.039488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50000707-7a3d-4f94-b6ac-6ee4dd57fb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.057394 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-50000707-7a3d-4f94-b6ac-6ee4dd57fb97 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:17.058605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-50000707-7a3d-4f94-b6ac-6ee4dd57fb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:17.114539 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 644/1273] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:27:17 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:27:17.139713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f23775-ec90-4cf2-ba36-b30f2b7c9c58 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.151848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f23775-ec90-4cf2-ba36-b30f2b7c9c58 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.156753 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4378f2-7a69-4ee4-bb63-152f014a89b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.157527 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4378f2-7a69-4ee4-bb63-152f014a89b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.157844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4378f2-7a69-4ee4-bb63-152f014a89b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.158122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4378f2-7a69-4ee4-bb63-152f014a89b6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.168232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4378f2-7a69-4ee4-bb63-152f014a89b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 13:27:17.175052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-2d4378f2-7a69-4ee4-bb63-152f014a89b6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 13:27:17.176204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 630/1274] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:17.182621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50000707-7a3d-4f94-b6ac-6ee4dd57fb97 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.191474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50000707-7a3d-4f94-b6ac-6ee4dd57fb97 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.196339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192bb78-110a-45f0-81bf-87ed24ce183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.197172 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192bb78-110a-45f0-81bf-87ed24ce183d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.197450 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192bb78-110a-45f0-81bf-87ed24ce183d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.197725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192bb78-110a-45f0-81bf-87ed24ce183d admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.198603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192bb78-110a-45f0-81bf-87ed24ce183d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:17.198903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192bb78-110a-45f0-81bf-87ed24ce183d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:17.201130 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192bb78-110a-45f0-81bf-87ed24ce183d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:17.209542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 645/1275] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:17.216414 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4378f2-7a69-4ee4-bb63-152f014a89b6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.226735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4378f2-7a69-4ee4-bb63-152f014a89b6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.232173 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1176eb3-89cf-481c-831e-07d2c14f9dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.233069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1176eb3-89cf-481c-831e-07d2c14f9dde admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.233344 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1176eb3-89cf-481c-831e-07d2c14f9dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.233614 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1176eb3-89cf-481c-831e-07d2c14f9dde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.243914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1176eb3-89cf-481c-831e-07d2c14f9dde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:17.245840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1176eb3-89cf-481c-831e-07d2c14f9dde admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:17.264689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-e1176eb3-89cf-481c-831e-07d2c14f9dde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:17.266098 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 631/1276] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:17.273287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192bb78-110a-45f0-81bf-87ed24ce183d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.285001 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192bb78-110a-45f0-81bf-87ed24ce183d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.290784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc2f89-863e-43b1-ae2f-f4926a2f176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.291542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc2f89-863e-43b1-ae2f-f4926a2f176d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.291884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc2f89-863e-43b1-ae2f-f4926a2f176d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.292226 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc2f89-863e-43b1-ae2f-f4926a2f176d admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.292957 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc2f89-863e-43b1-ae2f-f4926a2f176d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:17.293263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc2f89-863e-43b1-ae2f-f4926a2f176d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:17.295463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc2f89-863e-43b1-ae2f-f4926a2f176d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:17.307583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 646/1277] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:27:17.313983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1176eb3-89cf-481c-831e-07d2c14f9dde admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.323745 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1176eb3-89cf-481c-831e-07d2c14f9dde admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.328212 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994dafc-3cf9-463a-96b2-4a5783b79356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.328988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994dafc-3cf9-463a-96b2-4a5783b79356 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.329265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994dafc-3cf9-463a-96b2-4a5783b79356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.329533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994dafc-3cf9-463a-96b2-4a5783b79356 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.336625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994dafc-3cf9-463a-96b2-4a5783b79356 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:17.338617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994dafc-3cf9-463a-96b2-4a5783b79356 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:17.352735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-d994dafc-3cf9-463a-96b2-4a5783b79356 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 13:27:17.353858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 632/1278] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:17.360468 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc2f89-863e-43b1-ae2f-f4926a2f176d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.370159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc2f89-863e-43b1-ae2f-f4926a2f176d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.374875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c905f5-f302-4ee1-8881-ea425a50a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.375527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c905f5-f302-4ee1-8881-ea425a50a954 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.375802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c905f5-f302-4ee1-8881-ea425a50a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.376072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c905f5-f302-4ee1-8881-ea425a50a954 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.376917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c905f5-f302-4ee1-8881-ea425a50a954 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:17.377217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c905f5-f302-4ee1-8881-ea425a50a954 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:17.379068 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c905f5-f302-4ee1-8881-ea425a50a954 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:17.396762 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 647/1279] 10.222.0.83 () {56 vars in 1164 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:27:17.403962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994dafc-3cf9-463a-96b2-4a5783b79356 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.413963 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994dafc-3cf9-463a-96b2-4a5783b79356 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.419295 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4b1bb-ace2-428e-a625-4b9dbc5ba15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.419929 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4b1bb-ace2-428e-a625-4b9dbc5ba15c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.420212 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4b1bb-ace2-428e-a625-4b9dbc5ba15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.420487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4b1bb-ace2-428e-a625-4b9dbc5ba15c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.428473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4b1bb-ace2-428e-a625-4b9dbc5ba15c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:17.430258 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4b1bb-ace2-428e-a625-4b9dbc5ba15c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:17.439234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 633/1280] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:27:17.445944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c905f5-f302-4ee1-8881-ea425a50a954 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.456043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c905f5-f302-4ee1-8881-ea425a50a954 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.460766 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35317ef0-c96a-45b3-b91d-9d2837ed22c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.461554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317ef0-c96a-45b3-b91d-9d2837ed22c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.461861 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317ef0-c96a-45b3-b91d-9d2837ed22c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.462141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317ef0-c96a-45b3-b91d-9d2837ed22c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.473290 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35317ef0-c96a-45b3-b91d-9d2837ed22c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:17.475212 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35317ef0-c96a-45b3-b91d-9d2837ed22c7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:17.493198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-35317ef0-c96a-45b3-b91d-9d2837ed22c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 13:27:17.494403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 648/1281] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:17.500593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4b1bb-ace2-428e-a625-4b9dbc5ba15c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.509301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4b1bb-ace2-428e-a625-4b9dbc5ba15c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.513796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12705b-be9a-48bb-b82a-b8d9b017174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.514441 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12705b-be9a-48bb-b82a-b8d9b017174a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.514717 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12705b-be9a-48bb-b82a-b8d9b017174a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.514987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12705b-be9a-48bb-b82a-b8d9b017174a admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.515709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12705b-be9a-48bb-b82a-b8d9b017174a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:17.516008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12705b-be9a-48bb-b82a-b8d9b017174a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:17.517576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12705b-be9a-48bb-b82a-b8d9b017174a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:17.529497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 634/1282] 10.222.0.83 () {56 vars in 1130 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:17.535476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35317ef0-c96a-45b3-b91d-9d2837ed22c7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.545536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35317ef0-c96a-45b3-b91d-9d2837ed22c7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.550075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6a2ed-5857-417b-ae09-4c7ede6a7e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.550847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6a2ed-5857-417b-ae09-4c7ede6a7e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.551126 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6a2ed-5857-417b-ae09-4c7ede6a7e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.551397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6a2ed-5857-417b-ae09-4c7ede6a7e76 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.558185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6a2ed-5857-417b-ae09-4c7ede6a7e76 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:17.560107 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6a2ed-5857-417b-ae09-4c7ede6a7e76 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:17.573042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING keystone.server.flask.application [None req-6fd6a2ed-5857-417b-ae09-4c7ede6a7e76 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 13:27:17.574204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 649/1283] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:17.580414 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12705b-be9a-48bb-b82a-b8d9b017174a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.590129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12705b-be9a-48bb-b82a-b8d9b017174a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.595122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8c375-9533-420e-b128-5a32acc0bfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.595773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c375-9533-420e-b128-5a32acc0bfeb admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.596052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c375-9533-420e-b128-5a32acc0bfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.596325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c375-9533-420e-b128-5a32acc0bfeb admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.597119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8c375-9533-420e-b128-5a32acc0bfeb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:17.597424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8c375-9533-420e-b128-5a32acc0bfeb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:17.599291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8c375-9533-420e-b128-5a32acc0bfeb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:17.612559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 635/1284] 10.222.0.83 () {56 vars in 1169 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:17.619818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6a2ed-5857-417b-ae09-4c7ede6a7e76 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:17.631970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6a2ed-5857-417b-ae09-4c7ede6a7e76 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:17.636603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccea9a-253f-49cb-8447-742955477e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:17.637745 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccea9a-253f-49cb-8447-742955477e28 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:17.638099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccea9a-253f-49cb-8447-742955477e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:17.638381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccea9a-253f-49cb-8447-742955477e28 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:17.639278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccea9a-253f-49cb-8447-742955477e28 admin admin] RBAC: Adding query filter params (role.id=a312b345efeb490eb4234d1ace386dec, scope.project.id=3be4b5e724284f998093583529d1723e, user.id=797b1d42ac3a427bb084740a069b577d) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:17.639511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccea9a-253f-49cb-8447-742955477e28 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:17.641394 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccea9a-253f-49cb-8447-742955477e28 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:17.647337 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 650/1285] 10.222.0.83 () {56 vars in 1395 bytes} [Wed Dec 15 13:27:17 2021] GET /identity/v3/role_assignments?user.id=797b1d42ac3a427bb084740a069b577d&scope.project.id=3be4b5e724284f998093583529d1723e&role.id=a312b345efeb490eb4234d1ace386dec => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:27:20.066381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2d57f-fe26-4841-a90e-d14446ef7194 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:20.066926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2d57f-fe26-4841-a90e-d14446ef7194 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:20.066926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2d57f-fe26-4841-a90e-d14446ef7194 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:20.068633 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 636/1286] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:27:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:27:20.075300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3b801-f034-4f70-8ec8-d7c5b7695d37 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:20.075702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3b801-f034-4f70-8ec8-d7c5b7695d37 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:20.075847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3b801-f034-4f70-8ec8-d7c5b7695d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:20.093468 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e6d3b801-f034-4f70-8ec8-d7c5b7695d37 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:20.094673 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e6d3b801-f034-4f70-8ec8-d7c5b7695d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:20.102231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 651/1287] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:27:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:27:20.125079 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2d57f-fe26-4841-a90e-d14446ef7194 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:20.138933 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2d57f-fe26-4841-a90e-d14446ef7194 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:20.143611 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6dfe2-2012-4f23-8656-538bfbafa529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:20.144530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6dfe2-2012-4f23-8656-538bfbafa529 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:20.144811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6dfe2-2012-4f23-8656-538bfbafa529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:20.145087 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6dfe2-2012-4f23-8656-538bfbafa529 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:20.145768 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6dfe2-2012-4f23-8656-538bfbafa529 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:20.147434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6dfe2-2012-4f23-8656-538bfbafa529 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:20.159342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-fca6dfe2-2012-4f23-8656-538bfbafa529 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 13:27:20.160487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 637/1288] 10.222.0.83 () {56 vars in 1138 bytes} [Wed Dec 15 13:27:20 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:20.167198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3b801-f034-4f70-8ec8-d7c5b7695d37 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:20.176136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3b801-f034-4f70-8ec8-d7c5b7695d37 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:20.181030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e02667-606d-4228-954a-d772e995a97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:20.181682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02667-606d-4228-954a-d772e995a97e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:20.181995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02667-606d-4228-954a-d772e995a97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:20.182267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02667-606d-4228-954a-d772e995a97e admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:20.182980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e02667-606d-4228-954a-d772e995a97e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:20.183278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e02667-606d-4228-954a-d772e995a97e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:20.184851 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e02667-606d-4228-954a-d772e995a97e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:20.189904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 652/1289] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Dec 15 13:27:20 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:20.196550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6dfe2-2012-4f23-8656-538bfbafa529 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:20.207596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6dfe2-2012-4f23-8656-538bfbafa529 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:20.212714 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653ab6e-ee8e-4e1a-be63-788b8e4924ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:20.213361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653ab6e-ee8e-4e1a-be63-788b8e4924ff admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:20.213645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653ab6e-ee8e-4e1a-be63-788b8e4924ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:20.213950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653ab6e-ee8e-4e1a-be63-788b8e4924ff admin admin] PATH_INFO: `/v3/services` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:20.214670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653ab6e-ee8e-4e1a-be63-788b8e4924ff admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:20.214975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653ab6e-ee8e-4e1a-be63-788b8e4924ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:20.217170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653ab6e-ee8e-4e1a-be63-788b8e4924ff admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:20.222096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 638/1290] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Dec 15 13:27:20 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:27:22.606894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eed4a-95bc-4b25-8ab2-373c542c16f4 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:22.607471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eed4a-95bc-4b25-8ab2-373c542c16f4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:22.607471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eed4a-95bc-4b25-8ab2-373c542c16f4 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:22.609920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 653/1291] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:27:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:27:22.616441 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e67cd-d601-4857-960e-221d5fb5aea7 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:22.616897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e67cd-d601-4857-960e-221d5fb5aea7 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:22.617163 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e67cd-d601-4857-960e-221d5fb5aea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:22.637061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d63e67cd-d601-4857-960e-221d5fb5aea7 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:22.638347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d63e67cd-d601-4857-960e-221d5fb5aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:22.646452 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 639/1292] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:27:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:27:22.672599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0eed4a-95bc-4b25-8ab2-373c542c16f4 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:22.686955 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0eed4a-95bc-4b25-8ab2-373c542c16f4 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:22.691432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1902ad6-549e-4511-9e62-f7e76e2aea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:22.692130 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902ad6-549e-4511-9e62-f7e76e2aea24 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:22.692449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902ad6-549e-4511-9e62-f7e76e2aea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:22.692723 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902ad6-549e-4511-9e62-f7e76e2aea24 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:22.693462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1902ad6-549e-4511-9e62-f7e76e2aea24 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:22.695358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1902ad6-549e-4511-9e62-f7e76e2aea24 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:22.711227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 654/1293] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Dec 15 13:27:22 2021] POST /identity/v3/services => generated 246 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:27:25.155851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe9343-3103-4bd8-866a-d1bd466bcb29 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:25.156475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe9343-3103-4bd8-866a-d1bd466bcb29 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:25.156475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe9343-3103-4bd8-866a-d1bd466bcb29 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:25.158206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 640/1294] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:27:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:27:25.164101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b634d8-b1ae-464b-becc-aa9d8ffbbf9f None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:25.164630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b634d8-b1ae-464b-becc-aa9d8ffbbf9f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:25.164720 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b634d8-b1ae-464b-becc-aa9d8ffbbf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:25.182626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-41b634d8-b1ae-464b-becc-aa9d8ffbbf9f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:25.183821 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-41b634d8-b1ae-464b-becc-aa9d8ffbbf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:25.202089 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 655/1295] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:27:25 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:27:25.226201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe9343-3103-4bd8-866a-d1bd466bcb29 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:25.239083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe9343-3103-4bd8-866a-d1bd466bcb29 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:25.243699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6555fa-334d-4403-b28e-deb4b70938c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:25.244487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6555fa-334d-4403-b28e-deb4b70938c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:25.244763 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6555fa-334d-4403-b28e-deb4b70938c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:25.245031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6555fa-334d-4403-b28e-deb4b70938c1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:25.245685 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6555fa-334d-4403-b28e-deb4b70938c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:25.247897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6555fa-334d-4403-b28e-deb4b70938c1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:25.260953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-bd6555fa-334d-4403-b28e-deb4b70938c1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 13:27:25.262195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 641/1296] 10.222.0.83 () {56 vars in 1138 bytes} [Wed Dec 15 13:27:25 2021] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 13:27:25.269171 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b634d8-b1ae-464b-becc-aa9d8ffbbf9f None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:25.279823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b634d8-b1ae-464b-becc-aa9d8ffbbf9f None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:25.284462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dc0f9-4154-4657-a3c6-9d657e5f9d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:25.285129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dc0f9-4154-4657-a3c6-9d657e5f9d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:25.285413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dc0f9-4154-4657-a3c6-9d657e5f9d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:25.285692 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dc0f9-4154-4657-a3c6-9d657e5f9d96 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:25.286506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dc0f9-4154-4657-a3c6-9d657e5f9d96 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:25.286843 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dc0f9-4154-4657-a3c6-9d657e5f9d96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:25.288659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dc0f9-4154-4657-a3c6-9d657e5f9d96 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:25.295529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 656/1297] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Dec 15 13:27:25 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:27:25.303251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6555fa-334d-4403-b28e-deb4b70938c1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:25.315589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6555fa-334d-4403-b28e-deb4b70938c1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:25.320723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb820db-09c5-4199-ba39-08633916fa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:25.321385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb820db-09c5-4199-ba39-08633916fa14 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:25.321660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb820db-09c5-4199-ba39-08633916fa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:25.321962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb820db-09c5-4199-ba39-08633916fa14 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:25.322759 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb820db-09c5-4199-ba39-08633916fa14 admin admin] RBAC: Adding query filter params (interface=public, service_id=286f5d1bef7d4777b4d713270f3e0ccb, region_id=RegionOne) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:25.323064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb820db-09c5-4199-ba39-08633916fa14 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:25.324651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb820db-09c5-4199-ba39-08633916fa14 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:25.331461 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 642/1298] 10.222.0.83 () {56 vars in 1272 bytes} [Wed Dec 15 13:27:25 2021] GET /identity/v3/endpoints?service_id=286f5d1bef7d4777b4d713270f3e0ccb&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:27:25.339853 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dc0f9-4154-4657-a3c6-9d657e5f9d96 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:25.349580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dc0f9-4154-4657-a3c6-9d657e5f9d96 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:25.354364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f0947-7df9-4d64-8fc0-629855d61742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:25.355012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0947-7df9-4d64-8fc0-629855d61742 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:25.355291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0947-7df9-4d64-8fc0-629855d61742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:25.355565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0947-7df9-4d64-8fc0-629855d61742 admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:25.356784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f0947-7df9-4d64-8fc0-629855d61742 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:25.358461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f0947-7df9-4d64-8fc0-629855d61742 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:25.365074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 657/1299] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Dec 15 13:27:25 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:27:27.719119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecd8a6-2206-40fa-8ed1-d1100cb4d3f5 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:27.719655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecd8a6-2206-40fa-8ed1-d1100cb4d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:27.719655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecd8a6-2206-40fa-8ed1-d1100cb4d3f5 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:27.721397 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 643/1300] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:27:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:27:27.728002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899743f-6fed-4d3f-9130-1ecb090e1381 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:27.728490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899743f-6fed-4d3f-9130-1ecb090e1381 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:27.728590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899743f-6fed-4d3f-9130-1ecb090e1381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:27.747438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2899743f-6fed-4d3f-9130-1ecb090e1381 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:27:27.748659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2899743f-6fed-4d3f-9130-1ecb090e1381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:27:27.757005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 658/1301] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:27:27 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:27:27.782422 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecd8a6-2206-40fa-8ed1-d1100cb4d3f5 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:27.796166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecd8a6-2206-40fa-8ed1-d1100cb4d3f5 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:27.800834 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69f6fc-7807-45df-afd3-5790e71db496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:27.801636 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69f6fc-7807-45df-afd3-5790e71db496 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:27.801953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69f6fc-7807-45df-afd3-5790e71db496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:27.802229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69f6fc-7807-45df-afd3-5790e71db496 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:27.802891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69f6fc-7807-45df-afd3-5790e71db496 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:27.804512 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69f6fc-7807-45df-afd3-5790e71db496 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:27.816558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING keystone.server.flask.application [None req-4b69f6fc-7807-45df-afd3-5790e71db496 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 13:27:27.817781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 644/1302] 10.222.0.83 () {56 vars in 1138 bytes} [Wed Dec 15 13:27:27 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 13:27:27.829434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899743f-6fed-4d3f-9130-1ecb090e1381 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:27.843677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899743f-6fed-4d3f-9130-1ecb090e1381 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:27.850491 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f74ec-da19-4b8d-99ff-954fa9db138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:27.851549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f74ec-da19-4b8d-99ff-954fa9db138b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:27.852011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f74ec-da19-4b8d-99ff-954fa9db138b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:27.852477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f74ec-da19-4b8d-99ff-954fa9db138b admin admin] PATH_INFO: `/v3/services` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:27.853500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f74ec-da19-4b8d-99ff-954fa9db138b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:27:27.853841 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f74ec-da19-4b8d-99ff-954fa9db138b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:27.855880 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f74ec-da19-4b8d-99ff-954fa9db138b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:27.862788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 659/1303] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Dec 15 13:27:27 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:27:27.869295 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69f6fc-7807-45df-afd3-5790e71db496 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:27:27.879939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69f6fc-7807-45df-afd3-5790e71db496 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:27:27.884635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a31749-7952-4e6b-9cb1-7cb3e2e41b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:27:27.885288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31749-7952-4e6b-9cb1-7cb3e2e41b70 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:27:27.885572 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31749-7952-4e6b-9cb1-7cb3e2e41b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:27:27.885882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31749-7952-4e6b-9cb1-7cb3e2e41b70 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:27:27.886652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a31749-7952-4e6b-9cb1-7cb3e2e41b70 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:27:27.888815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a31749-7952-4e6b-9cb1-7cb3e2e41b70 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:27:27.909627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 645/1304] 10.222.0.83 () {60 vars in 1165 bytes} [Wed Dec 15 13:27:27 2021] POST /identity/v3/endpoints => generated 331 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:28:32.684213 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c9950-ece8-4c79-ba16-abf360289c32 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:32.685164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c9950-ece8-4c79-ba16-abf360289c32 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:32.685592 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c9950-ece8-4c79-ba16-abf360289c32 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:32.692984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 660/1305] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:28:32 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:28:32.694471 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de4f3d-a86c-4aeb-a65d-c11bfb77fb4e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:32.695296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de4f3d-a86c-4aeb-a65d-c11bfb77fb4e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:32.695725 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de4f3d-a86c-4aeb-a65d-c11bfb77fb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:32.780035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d3de4f3d-a86c-4aeb-a65d-c11bfb77fb4e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:28:32.781507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d3de4f3d-a86c-4aeb-a65d-c11bfb77fb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:32.922930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 646/1306] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:28:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:28:32.932561 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c9950-ece8-4c79-ba16-abf360289c32 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:32.934515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b48c9950-ece8-4c79-ba16-abf360289c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:33.089011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c9950-ece8-4c79-ba16-abf360289c32 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:33.197775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a20a7b-25ec-422c-9ab8-44d94193b351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:33.198813 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a20a7b-25ec-422c-9ab8-44d94193b351 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:33.199097 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a20a7b-25ec-422c-9ab8-44d94193b351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:33.199371 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a20a7b-25ec-422c-9ab8-44d94193b351 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:33.200421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a20a7b-25ec-422c-9ab8-44d94193b351 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:33.202516 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a20a7b-25ec-422c-9ab8-44d94193b351 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:33.228375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 661/1307] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Dec 15 13:28:32 2021] GET /identity/v3/projects => generated 2553 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:28:35.782631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cabd69-571e-470b-a9ed-b7c82638711e None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:35.783152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cabd69-571e-470b-a9ed-b7c82638711e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:35.783243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cabd69-571e-470b-a9ed-b7c82638711e None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:35.784967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 647/1308] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:28:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:28:35.790633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8e47b-e891-484c-a034-c8d463b9d9e9 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:35.791061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8e47b-e891-484c-a034-c8d463b9d9e9 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:35.791278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8e47b-e891-484c-a034-c8d463b9d9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:35.871925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a6e8e47b-e891-484c-a034-c8d463b9d9e9 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:28:35.873164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a6e8e47b-e891-484c-a034-c8d463b9d9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:35.969211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 662/1309] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:28:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:28:36.020143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651df2-243d-4db1-9384-9e2f200ca345 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:36.020426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651df2-243d-4db1-9384-9e2f200ca345 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:36.020701 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651df2-243d-4db1-9384-9e2f200ca345 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:36.022501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 648/1310] 10.222.0.83 () {54 vars in 964 bytes} [Wed Dec 15 13:28:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:28:36.029169 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bb16-cb76-43f2-9ad6-7a9cf56be325 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:36.029451 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bb16-cb76-43f2-9ad6-7a9cf56be325 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:36.029726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bb16-cb76-43f2-9ad6-7a9cf56be325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:36.102331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-ddd0bb16-cb76-43f2-9ad6-7a9cf56be325 None None] MFA Rules not processed for user `de1632f6a5414d2abfdee3b5bdd941cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:28:36.103534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ddd0bb16-cb76-43f2-9ad6-7a9cf56be325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:36.175965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 663/1311] 10.222.0.83 () {58 vars in 1061 bytes} [Wed Dec 15 13:28:36 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:28:36.184978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18651df2-243d-4db1-9384-9e2f200ca345 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:36.186519 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-18651df2-243d-4db1-9384-9e2f200ca345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:36.295440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18651df2-243d-4db1-9384-9e2f200ca345 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:36.369440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b509369-0985-4946-8b59-15eb4397c746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:36.370368 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b509369-0985-4946-8b59-15eb4397c746 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:36.370752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b509369-0985-4946-8b59-15eb4397c746 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:36.371115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b509369-0985-4946-8b59-15eb4397c746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:36.372847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7b509369-0985-4946-8b59-15eb4397c746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:36.483144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b509369-0985-4946-8b59-15eb4397c746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:36.485205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b509369-0985-4946-8b59-15eb4397c746 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:36.503149 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 649/1312] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:28:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:28:39.148608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1578fe0-4254-4e35-8d2e-5d093fb94f19 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:39.149124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1578fe0-4254-4e35-8d2e-5d093fb94f19 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:39.149212 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1578fe0-4254-4e35-8d2e-5d093fb94f19 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:39.150990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 664/1313] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:28:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:28:39.157223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207580-8044-4179-b421-f62b3cb37da0 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:39.157640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207580-8044-4179-b421-f62b3cb37da0 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:39.157810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207580-8044-4179-b421-f62b3cb37da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:39.221313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d4207580-8044-4179-b421-f62b3cb37da0 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:28:39.222574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d4207580-8044-4179-b421-f62b3cb37da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:39.320489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 650/1314] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:28:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:28:39.359198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1578fe0-4254-4e35-8d2e-5d093fb94f19 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:39.361391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f1578fe0-4254-4e35-8d2e-5d093fb94f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:39.460335 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1578fe0-4254-4e35-8d2e-5d093fb94f19 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:39.529643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbe173-6def-4896-96c9-7f23f4e0d4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:39.530307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbe173-6def-4896-96c9-7f23f4e0d4fb service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:39.530587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbe173-6def-4896-96c9-7f23f4e0d4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:39.530856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbe173-6def-4896-96c9-7f23f4e0d4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:39.533060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-05bbe173-6def-4896-96c9-7f23f4e0d4fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:39.636890 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbe173-6def-4896-96c9-7f23f4e0d4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:39.638360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbe173-6def-4896-96c9-7f23f4e0d4fb service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:39.655935 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 665/1315] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:28:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:28:42.329066 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdc7d9-02f6-41f9-ba9d-bfc38e9f6da4 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:42.329659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdc7d9-02f6-41f9-ba9d-bfc38e9f6da4 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:42.329659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdc7d9-02f6-41f9-ba9d-bfc38e9f6da4 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:42.331425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 651/1316] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:28:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:28:42.337044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0019e-67a7-4ed1-8ace-51186d814dff None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:42.337476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0019e-67a7-4ed1-8ace-51186d814dff None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:42.337596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0019e-67a7-4ed1-8ace-51186d814dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:42.400037 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-80a0019e-67a7-4ed1-8ace-51186d814dff None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:28:42.401217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-80a0019e-67a7-4ed1-8ace-51186d814dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:42.491248 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 666/1317] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:28:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:28:42.527016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdc7d9-02f6-41f9-ba9d-bfc38e9f6da4 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:42.528520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-19bdc7d9-02f6-41f9-ba9d-bfc38e9f6da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:42.649433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdc7d9-02f6-41f9-ba9d-bfc38e9f6da4 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:42.742084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf7f3c-8a74-4df6-8f6f-dd5dea54d624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:42.742934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf7f3c-8a74-4df6-8f6f-dd5dea54d624 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:42.743212 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf7f3c-8a74-4df6-8f6f-dd5dea54d624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:42.743479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf7f3c-8a74-4df6-8f6f-dd5dea54d624 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:42.753411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf7f3c-8a74-4df6-8f6f-dd5dea54d624 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:42.755474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf7f3c-8a74-4df6-8f6f-dd5dea54d624 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:42.757131 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 652/1318] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:28:42 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:28:42.770232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0019e-67a7-4ed1-8ace-51186d814dff None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:42.771429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-80a0019e-67a7-4ed1-8ace-51186d814dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:42.856890 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0019e-67a7-4ed1-8ace-51186d814dff None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:42.925609 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0cddf-a40d-4cad-88fe-18253b0d04d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:42.926210 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0cddf-a40d-4cad-88fe-18253b0d04d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:42.926492 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0cddf-a40d-4cad-88fe-18253b0d04d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:42.926765 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0cddf-a40d-4cad-88fe-18253b0d04d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:42.928381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-75b0cddf-a40d-4cad-88fe-18253b0d04d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:43.031062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0cddf-a40d-4cad-88fe-18253b0d04d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:43.032498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0cddf-a40d-4cad-88fe-18253b0d04d1 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:43.049654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 667/1319] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:28:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:28:45.923892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dddc18-5bad-4963-adca-03e70c7ca545 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:45.924440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dddc18-5bad-4963-adca-03e70c7ca545 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:45.924440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dddc18-5bad-4963-adca-03e70c7ca545 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:45.926155 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 653/1320] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:28:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:28:45.931748 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab1d6-a4cf-4d98-b9b8-9be734e3670d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:45.932176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab1d6-a4cf-4d98-b9b8-9be734e3670d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:45.932301 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab1d6-a4cf-4d98-b9b8-9be734e3670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:45.995554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-6c3ab1d6-a4cf-4d98-b9b8-9be734e3670d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:28:45.996729 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6c3ab1d6-a4cf-4d98-b9b8-9be734e3670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:46.087625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 668/1321] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:28:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:28:46.121877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dddc18-5bad-4963-adca-03e70c7ca545 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:46.123419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f3dddc18-5bad-4963-adca-03e70c7ca545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:46.244471 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dddc18-5bad-4963-adca-03e70c7ca545 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:46.333326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a27a7-367a-4d06-8f41-26ac1b74e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:46.334207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a27a7-367a-4d06-8f41-26ac1b74e602 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:46.334484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a27a7-367a-4d06-8f41-26ac1b74e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:46.334751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a27a7-367a-4d06-8f41-26ac1b74e602 admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:46.344300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a27a7-367a-4d06-8f41-26ac1b74e602 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:46.346365 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a27a7-367a-4d06-8f41-26ac1b74e602 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:46.348034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 654/1322] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:28:46 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:28:46.360591 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ab1d6-a4cf-4d98-b9b8-9be734e3670d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:46.361840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6c3ab1d6-a4cf-4d98-b9b8-9be734e3670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:46.447732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ab1d6-a4cf-4d98-b9b8-9be734e3670d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:46.517706 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e2f3c-f15e-47b2-8cb8-c2ba35a0230a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:46.518296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e2f3c-f15e-47b2-8cb8-c2ba35a0230a service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:46.518573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e2f3c-f15e-47b2-8cb8-c2ba35a0230a service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:46.518845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e2f3c-f15e-47b2-8cb8-c2ba35a0230a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:46.520446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1f8e2f3c-f15e-47b2-8cb8-c2ba35a0230a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:46.623702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e2f3c-f15e-47b2-8cb8-c2ba35a0230a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:46.625120 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e2f3c-f15e-47b2-8cb8-c2ba35a0230a service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:46.643693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 669/1323] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:28:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:28:49.631439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7434ddf-e9c9-4638-82d8-c3109c6b4877 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:49.631950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7434ddf-e9c9-4638-82d8-c3109c6b4877 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:49.632039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7434ddf-e9c9-4638-82d8-c3109c6b4877 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:49.633786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 655/1324] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:28:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:28:49.639594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98550f98-0415-4ccf-86d9-ac73678ac671 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:49.640013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98550f98-0415-4ccf-86d9-ac73678ac671 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:49.640138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98550f98-0415-4ccf-86d9-ac73678ac671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:49.711719 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-98550f98-0415-4ccf-86d9-ac73678ac671 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:28:49.713026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-98550f98-0415-4ccf-86d9-ac73678ac671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:49.807532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 670/1325] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:28:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:28:49.845594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7434ddf-e9c9-4638-82d8-c3109c6b4877 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:49.847187 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a7434ddf-e9c9-4638-82d8-c3109c6b4877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:49.946174 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7434ddf-e9c9-4638-82d8-c3109c6b4877 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:50.015590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519e6aa-a181-4352-9a00-107b0f78b511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:50.016235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519e6aa-a181-4352-9a00-107b0f78b511 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:50.016543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519e6aa-a181-4352-9a00-107b0f78b511 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:50.016815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519e6aa-a181-4352-9a00-107b0f78b511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:50.018478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3519e6aa-a181-4352-9a00-107b0f78b511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:50.121453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519e6aa-a181-4352-9a00-107b0f78b511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:50.122901 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519e6aa-a181-4352-9a00-107b0f78b511 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:50.140639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 656/1326] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:28:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:28:52.521330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ec359-a645-487f-a69a-2ee1657c441c None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:52.521891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ec359-a645-487f-a69a-2ee1657c441c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:52.521891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ec359-a645-487f-a69a-2ee1657c441c None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:52.523526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 671/1327] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:28:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:28:52.529160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa8f9e-20a8-4cb0-aa18-dbd058869662 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:52.529561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa8f9e-20a8-4cb0-aa18-dbd058869662 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:52.529698 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa8f9e-20a8-4cb0-aa18-dbd058869662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:52.593325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-ebaa8f9e-20a8-4cb0-aa18-dbd058869662 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:28:52.594528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ebaa8f9e-20a8-4cb0-aa18-dbd058869662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:52.690647 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 657/1328] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:28:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:28:52.727715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ec359-a645-487f-a69a-2ee1657c441c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:52.729326 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-006ec359-a645-487f-a69a-2ee1657c441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:52.836092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ec359-a645-487f-a69a-2ee1657c441c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:52.906080 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448b86f-7fc7-4e6c-b801-d8fb71b204bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:52.906720 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448b86f-7fc7-4e6c-b801-d8fb71b204bf service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:52.906997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448b86f-7fc7-4e6c-b801-d8fb71b204bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:52.907803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448b86f-7fc7-4e6c-b801-d8fb71b204bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:52.909430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b448b86f-7fc7-4e6c-b801-d8fb71b204bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:53.011507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448b86f-7fc7-4e6c-b801-d8fb71b204bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:53.012931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448b86f-7fc7-4e6c-b801-d8fb71b204bf service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:53.030768 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 672/1329] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:28:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:28:55.443259 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fa107-7631-4804-906c-cb9da15e1c22 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:55.443853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fa107-7631-4804-906c-cb9da15e1c22 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:55.443853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fa107-7631-4804-906c-cb9da15e1c22 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:55.445542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 658/1330] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:28:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:28:55.451606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b65027-9748-4121-93c0-40abb3cfe8fa None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:55.452029 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b65027-9748-4121-93c0-40abb3cfe8fa None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:55.452282 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b65027-9748-4121-93c0-40abb3cfe8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:55.515542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-b6b65027-9748-4121-93c0-40abb3cfe8fa None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:28:55.517317 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b6b65027-9748-4121-93c0-40abb3cfe8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:55.609445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 673/1331] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:28:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:28:55.644192 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fa107-7631-4804-906c-cb9da15e1c22 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:55.645733 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-269fa107-7631-4804-906c-cb9da15e1c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:55.774151 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fa107-7631-4804-906c-cb9da15e1c22 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:55.866462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253b308-5271-4abb-920e-8c9cb69a31af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:55.867312 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b308-5271-4abb-920e-8c9cb69a31af admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:55.867589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b308-5271-4abb-920e-8c9cb69a31af admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:55.867859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b308-5271-4abb-920e-8c9cb69a31af admin admin] PATH_INFO: `/v3/projects/eb37d41816d74f66a5087e325e84211f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:55.878530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253b308-5271-4abb-920e-8c9cb69a31af admin admin] RBAC: Authorizing `identity:get_project(project_id=eb37d41816d74f66a5087e325e84211f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:55.880576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253b308-5271-4abb-920e-8c9cb69a31af admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:55.882580 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 659/1332] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Dec 15 13:28:55 2021] GET /identity/v3/projects/eb37d41816d74f66a5087e325e84211f => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:28:55.910517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef25bc-2041-4056-a459-42cf97d97f9f None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:55.910802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef25bc-2041-4056-a459-42cf97d97f9f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:55.911077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef25bc-2041-4056-a459-42cf97d97f9f None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:55.912838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 674/1333] 10.222.0.83 () {54 vars in 964 bytes} [Wed Dec 15 13:28:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:28:55.919261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced0206-3727-4397-bec7-f5fc1c801ade None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:55.919550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced0206-3727-4397-bec7-f5fc1c801ade None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:55.919826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced0206-3727-4397-bec7-f5fc1c801ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:55.995137 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-aced0206-3727-4397-bec7-f5fc1c801ade None None] MFA Rules not processed for user `de1632f6a5414d2abfdee3b5bdd941cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:28:55.996446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-aced0206-3727-4397-bec7-f5fc1c801ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:56.068900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 660/1334] 10.222.0.83 () {58 vars in 1061 bytes} [Wed Dec 15 13:28:55 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:28:56.078441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef25bc-2041-4056-a459-42cf97d97f9f None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:56.080560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bfef25bc-2041-4056-a459-42cf97d97f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:56.198210 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef25bc-2041-4056-a459-42cf97d97f9f None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:56.275400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb06eb2-66ac-4a3d-bab7-e4ba80a167b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:56.276044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06eb2-66ac-4a3d-bab7-e4ba80a167b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:56.276325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06eb2-66ac-4a3d-bab7-e4ba80a167b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:56.276597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06eb2-66ac-4a3d-bab7-e4ba80a167b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:56.278241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-fdb06eb2-66ac-4a3d-bab7-e4ba80a167b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:56.382819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb06eb2-66ac-4a3d-bab7-e4ba80a167b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:56.384232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb06eb2-66ac-4a3d-bab7-e4ba80a167b1 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:56.404388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 675/1335] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:28:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:28:59.429188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7a5d5-f972-46de-a3d2-f7d506d14b00 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:59.429730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7a5d5-f972-46de-a3d2-f7d506d14b00 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:59.429730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7a5d5-f972-46de-a3d2-f7d506d14b00 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:59.431684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 661/1336] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:28:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:28:59.437504 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc4d4a-9680-42a3-b1b8-d97fb04aec5a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:59.437934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc4d4a-9680-42a3-b1b8-d97fb04aec5a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:59.438083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc4d4a-9680-42a3-b1b8-d97fb04aec5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:59.504617 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-17bc4d4a-9680-42a3-b1b8-d97fb04aec5a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:28:59.505839 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-17bc4d4a-9680-42a3-b1b8-d97fb04aec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:59.597159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 676/1337] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:28:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:28:59.642841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7a5d5-f972-46de-a3d2-f7d506d14b00 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:28:59.644419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f2d7a5d5-f972-46de-a3d2-f7d506d14b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:59.755628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7a5d5-f972-46de-a3d2-f7d506d14b00 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:28:59.827088 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de5a8b-d440-4319-9d27-a884d1f976a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:28:59.827729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5a8b-d440-4319-9d27-a884d1f976a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:28:59.828011 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5a8b-d440-4319-9d27-a884d1f976a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:28:59.828284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5a8b-d440-4319-9d27-a884d1f976a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:28:59.830495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d3de5a8b-d440-4319-9d27-a884d1f976a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:28:59.934689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de5a8b-d440-4319-9d27-a884d1f976a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:28:59.936113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de5a8b-d440-4319-9d27-a884d1f976a9 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:28:59.953376 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 662/1338] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:28:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:02.397489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ec6d-60eb-47ce-aef2-2cc32c51001d None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:02.398041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ec6d-60eb-47ce-aef2-2cc32c51001d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:02.398041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ec6d-60eb-47ce-aef2-2cc32c51001d None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:02.399805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 677/1339] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:02.405567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa594-8815-4f30-9dcd-97e4650410ad None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:02.406002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa594-8815-4f30-9dcd-97e4650410ad None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:02.406157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa594-8815-4f30-9dcd-97e4650410ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:02.468634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-bdcfa594-8815-4f30-9dcd-97e4650410ad None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:02.469743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-bdcfa594-8815-4f30-9dcd-97e4650410ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:02.560286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 663/1340] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:02.603054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9ec6d-60eb-47ce-aef2-2cc32c51001d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:02.604726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f5a9ec6d-60eb-47ce-aef2-2cc32c51001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:02.707036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9ec6d-60eb-47ce-aef2-2cc32c51001d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:02.778536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a305738-93ee-4751-a972-06b0e5d6ef5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:02.779099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a305738-93ee-4751-a972-06b0e5d6ef5e service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:02.779379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a305738-93ee-4751-a972-06b0e5d6ef5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:02.779658 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a305738-93ee-4751-a972-06b0e5d6ef5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:02.781311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6a305738-93ee-4751-a972-06b0e5d6ef5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:02.891448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a305738-93ee-4751-a972-06b0e5d6ef5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:02.892870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a305738-93ee-4751-a972-06b0e5d6ef5e service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:02.910792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 678/1341] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:05.761576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71061ae7-f0e7-4d35-8058-36751342cb84 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:05.762162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71061ae7-f0e7-4d35-8058-36751342cb84 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:05.762162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71061ae7-f0e7-4d35-8058-36751342cb84 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:05.764030 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 664/1342] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:05.770642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123290-b855-4a15-9450-7a31d7906df0 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:05.771104 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123290-b855-4a15-9450-7a31d7906df0 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:05.771194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123290-b855-4a15-9450-7a31d7906df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:05.849463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-23123290-b855-4a15-9450-7a31d7906df0 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:05.850717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-23123290-b855-4a15-9450-7a31d7906df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:05.963154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 679/1343] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:06.000699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71061ae7-f0e7-4d35-8058-36751342cb84 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:06.004060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-71061ae7-f0e7-4d35-8058-36751342cb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:06.109171 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71061ae7-f0e7-4d35-8058-36751342cb84 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:06.112888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146631d2-19dc-4fc1-87d1-1a483e35d9ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:06.113536 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146631d2-19dc-4fc1-87d1-1a483e35d9ab service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:06.113841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146631d2-19dc-4fc1-87d1-1a483e35d9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:06.114116 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146631d2-19dc-4fc1-87d1-1a483e35d9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:06.123668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146631d2-19dc-4fc1-87d1-1a483e35d9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:06.125120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146631d2-19dc-4fc1-87d1-1a483e35d9ab service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:06.135502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 665/1344] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:10.514190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434a8e-5a7d-410e-bf2c-70a32da3b380 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:10.514744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434a8e-5a7d-410e-bf2c-70a32da3b380 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:10.514744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434a8e-5a7d-410e-bf2c-70a32da3b380 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:10.516523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 680/1345] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:10.523077 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745de46-60fa-4443-90df-2a74fb6f4e82 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:10.523554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745de46-60fa-4443-90df-2a74fb6f4e82 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:10.523665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745de46-60fa-4443-90df-2a74fb6f4e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:10.541536 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-a745de46-60fa-4443-90df-2a74fb6f4e82 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:10.542761 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a745de46-60fa-4443-90df-2a74fb6f4e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:10.550651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 666/1346] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:10.591458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19434a8e-5a7d-410e-bf2c-70a32da3b380 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:10.593193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-19434a8e-5a7d-410e-bf2c-70a32da3b380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:10.606203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19434a8e-5a7d-410e-bf2c-70a32da3b380 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:10.609714 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa490e-a1ce-4100-99aa-955dad0a05e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:10.610388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa490e-a1ce-4100-99aa-955dad0a05e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:10.610671 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa490e-a1ce-4100-99aa-955dad0a05e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:10.610948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa490e-a1ce-4100-99aa-955dad0a05e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:10.620150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa490e-a1ce-4100-99aa-955dad0a05e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:10.621573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa490e-a1ce-4100-99aa-955dad0a05e3 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:10.631634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 681/1347] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:13.601233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972580c-a0dc-457b-9a25-f9fb752b85c5 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:13.601827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972580c-a0dc-457b-9a25-f9fb752b85c5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:13.601827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972580c-a0dc-457b-9a25-f9fb752b85c5 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:13.603478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 667/1348] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:13.609345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e87ef2-1819-445b-88fc-985fa31bd2b5 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:13.609786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e87ef2-1819-445b-88fc-985fa31bd2b5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:13.610056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e87ef2-1819-445b-88fc-985fa31bd2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:13.628089 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d5e87ef2-1819-445b-88fc-985fa31bd2b5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:13.629285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d5e87ef2-1819-445b-88fc-985fa31bd2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:13.637094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 682/1349] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:13.675642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972580c-a0dc-457b-9a25-f9fb752b85c5 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:13.686383 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972580c-a0dc-457b-9a25-f9fb752b85c5 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:13.690644 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ae9af-bfde-431c-b30c-5b74ffd9a3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:13.691285 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ae9af-bfde-431c-b30c-5b74ffd9a3fc service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:13.691569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ae9af-bfde-431c-b30c-5b74ffd9a3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:13.691844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ae9af-bfde-431c-b30c-5b74ffd9a3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:13.701088 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ae9af-bfde-431c-b30c-5b74ffd9a3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:13.702550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ae9af-bfde-431c-b30c-5b74ffd9a3fc service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:13.713200 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 668/1350] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:18.381543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c6cf-abcd-4056-8e7b-f771bae4f323 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:18.382106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c6cf-abcd-4056-8e7b-f771bae4f323 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:18.382106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c6cf-abcd-4056-8e7b-f771bae4f323 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:18.383855 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 683/1351] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:18.389731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4392295-75cd-49ad-a70f-33a2ad48178d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:18.390159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4392295-75cd-49ad-a70f-33a2ad48178d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:18.390642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4392295-75cd-49ad-a70f-33a2ad48178d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:18.409961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b4392295-75cd-49ad-a70f-33a2ad48178d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:18.411464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b4392295-75cd-49ad-a70f-33a2ad48178d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:18.419748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 669/1352] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:18.459611 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48c6cf-abcd-4056-8e7b-f771bae4f323 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:18.472124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48c6cf-abcd-4056-8e7b-f771bae4f323 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:18.475682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28639554-ceb4-440f-ae64-72c1291eb31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:18.476354 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28639554-ceb4-440f-ae64-72c1291eb31d service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:18.476764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28639554-ceb4-440f-ae64-72c1291eb31d service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:18.477180 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28639554-ceb4-440f-ae64-72c1291eb31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:18.486320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28639554-ceb4-440f-ae64-72c1291eb31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:18.487849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28639554-ceb4-440f-ae64-72c1291eb31d service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:18.497182 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 684/1353] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:23.609893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0d2f9-6c42-4064-a039-f2cb2fcc00ae None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:23.610735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0d2f9-6c42-4064-a039-f2cb2fcc00ae None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:23.611164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0d2f9-6c42-4064-a039-f2cb2fcc00ae None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:23.613735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 670/1354] 10.222.0.83 () {54 vars in 921 bytes} [Wed Dec 15 13:29:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:23.620883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26dc2-93ab-44a8-953a-17161c4a9f62 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:23.621792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26dc2-93ab-44a8-953a-17161c4a9f62 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:23.622252 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26dc2-93ab-44a8-953a-17161c4a9f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:23.724006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-79d26dc2-93ab-44a8-953a-17161c4a9f62 None None] MFA Rules not processed for user `797b1d42ac3a427bb084740a069b577d`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:23.725983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-79d26dc2-93ab-44a8-953a-17161c4a9f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:23.839909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 685/1355] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Dec 15 13:29:23 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:28.308499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bffcaf-fcb3-4822-be71-e65eaea7bfed None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:28.309205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bffcaf-fcb3-4822-be71-e65eaea7bfed None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:28.310157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bffcaf-fcb3-4822-be71-e65eaea7bfed None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:28.313347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 671/1356] 10.222.0.83 () {54 vars in 921 bytes} [Wed Dec 15 13:29:28 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:28.319924 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa369-6328-4068-9d97-0fb96279cbdc None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:28.320407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa369-6328-4068-9d97-0fb96279cbdc None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:28.320564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa369-6328-4068-9d97-0fb96279cbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:28.341391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-06aaa369-6328-4068-9d97-0fb96279cbdc None None] MFA Rules not processed for user `797b1d42ac3a427bb084740a069b577d`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:28.342612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-06aaa369-6328-4068-9d97-0fb96279cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:28.352077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 686/1357] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Dec 15 13:29:28 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:30.083417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8828-1e8e-4b17-a0f8-e8a6e479913d None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:30.083930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8828-1e8e-4b17-a0f8-e8a6e479913d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:30.083930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8828-1e8e-4b17-a0f8-e8a6e479913d None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:30.085671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 672/1358] 10.222.0.83 () {54 vars in 921 bytes} [Wed Dec 15 13:29:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:30.092281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c7651-03a3-4332-a2ec-49895079d3c2 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:30.092777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c7651-03a3-4332-a2ec-49895079d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:30.093125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c7651-03a3-4332-a2ec-49895079d3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:30.115105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2a4c7651-03a3-4332-a2ec-49895079d3c2 None None] MFA Rules not processed for user `797b1d42ac3a427bb084740a069b577d`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:30.116405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2a4c7651-03a3-4332-a2ec-49895079d3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:30.125496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 687/1359] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Dec 15 13:29:30 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:33.932142 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803507-4ecd-4bd6-9bc6-56308a33d431 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:33.932739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803507-4ecd-4bd6-9bc6-56308a33d431 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:33.932739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803507-4ecd-4bd6-9bc6-56308a33d431 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:33.934733 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 673/1360] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:29:33.940997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f708ee-9a1d-42c8-9c98-52845dcf8bd2 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:33.941878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f708ee-9a1d-42c8-9c98-52845dcf8bd2 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:33.942163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f708ee-9a1d-42c8-9c98-52845dcf8bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:33.968211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-36f708ee-9a1d-42c8-9c98-52845dcf8bd2 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:33.968211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-36f708ee-9a1d-42c8-9c98-52845dcf8bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:33.981849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 688/1361] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:34.026210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6c99b-8a35-4aec-b4c1-efd94da8cf1b None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:34.026493 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6c99b-8a35-4aec-b4c1-efd94da8cf1b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:34.026945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6c99b-8a35-4aec-b4c1-efd94da8cf1b None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:34.028699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 674/1362] 10.222.0.83 () {54 vars in 961 bytes} [Wed Dec 15 13:29:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:34.036475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cbd5d-c07a-451c-91a5-8747fe7fd7cf None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:34.037545 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cbd5d-c07a-451c-91a5-8747fe7fd7cf None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:34.038075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cbd5d-c07a-451c-91a5-8747fe7fd7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:34.115496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-697cbd5d-c07a-451c-91a5-8747fe7fd7cf None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:34.116965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-697cbd5d-c07a-451c-91a5-8747fe7fd7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:34.225515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 689/1363] 10.222.0.83 () {58 vars in 1058 bytes} [Wed Dec 15 13:29:34 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:34.233838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6c99b-8a35-4aec-b4c1-efd94da8cf1b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:34.250206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6c99b-8a35-4aec-b4c1-efd94da8cf1b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:34.259809 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f61ee-52f9-418d-ab73-f153146091bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:34.261001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f61ee-52f9-418d-ab73-f153146091bb service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:34.261607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f61ee-52f9-418d-ab73-f153146091bb service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:34.262396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f61ee-52f9-418d-ab73-f153146091bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:34.275482 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f61ee-52f9-418d-ab73-f153146091bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:34.277091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f61ee-52f9-418d-ab73-f153146091bb service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:34.291400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 675/1364] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:37.043811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b33a1-d65c-43c7-8bbd-8d34fec55230 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:37.044629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b33a1-d65c-43c7-8bbd-8d34fec55230 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:37.044629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b33a1-d65c-43c7-8bbd-8d34fec55230 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:37.047533 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 690/1365] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:37.052800 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a50c2-c264-4bb3-8b8b-d3f09aeb6934 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:37.053619 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a50c2-c264-4bb3-8b8b-d3f09aeb6934 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:37.053619 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a50c2-c264-4bb3-8b8b-d3f09aeb6934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:37.084056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-827a50c2-c264-4bb3-8b8b-d3f09aeb6934 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:37.085824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-827a50c2-c264-4bb3-8b8b-d3f09aeb6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:37.097096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 676/1366] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:37.159860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b33a1-d65c-43c7-8bbd-8d34fec55230 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:37.174807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b33a1-d65c-43c7-8bbd-8d34fec55230 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:37.181918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64dc78-b33b-435c-b24a-0a687d3465cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:37.182728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64dc78-b33b-435c-b24a-0a687d3465cd service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:37.183078 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64dc78-b33b-435c-b24a-0a687d3465cd service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:37.183425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64dc78-b33b-435c-b24a-0a687d3465cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:37.194287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64dc78-b33b-435c-b24a-0a687d3465cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:37.196155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64dc78-b33b-435c-b24a-0a687d3465cd service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:37.207799 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 691/1367] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:40.407830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33af1f-3698-41d8-aa8b-8339f1b78679 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:40.408874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33af1f-3698-41d8-aa8b-8339f1b78679 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:40.409245 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33af1f-3698-41d8-aa8b-8339f1b78679 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:40.411309 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 677/1368] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:40.417419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef957a-dd17-4411-a619-92d92b35578e None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:40.417932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef957a-dd17-4411-a619-92d92b35578e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:40.418161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef957a-dd17-4411-a619-92d92b35578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:40.438391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-deef957a-dd17-4411-a619-92d92b35578e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:40.439630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-deef957a-dd17-4411-a619-92d92b35578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:40.449188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 692/1369] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:40.505595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8de2-0499-4c45-ab68-c70879e52494 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:40.506108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8de2-0499-4c45-ab68-c70879e52494 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:40.506574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8de2-0499-4c45-ab68-c70879e52494 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:40.508653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 678/1370] 10.222.0.83 () {54 vars in 961 bytes} [Wed Dec 15 13:29:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:40.515294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b04d-2959-4315-be27-5ad5ad65877b None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:40.515576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b04d-2959-4315-be27-5ad5ad65877b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:40.516023 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b04d-2959-4315-be27-5ad5ad65877b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:40.535915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-0477b04d-2959-4315-be27-5ad5ad65877b None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:40.537144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0477b04d-2959-4315-be27-5ad5ad65877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:40.547287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 693/1371] 10.222.0.83 () {58 vars in 1058 bytes} [Wed Dec 15 13:29:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:40.556591 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb8de2-0499-4c45-ab68-c70879e52494 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:40.576852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb8de2-0499-4c45-ab68-c70879e52494 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:40.584241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d08556-f231-4f6b-af00-cb16530dfc8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:40.584896 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d08556-f231-4f6b-af00-cb16530dfc8f service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:40.585178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d08556-f231-4f6b-af00-cb16530dfc8f service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:40.585453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d08556-f231-4f6b-af00-cb16530dfc8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:40.594547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d08556-f231-4f6b-af00-cb16530dfc8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:40.596140 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d08556-f231-4f6b-af00-cb16530dfc8f service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:40.607265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 679/1372] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:42.775484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420975d-b69a-43e1-b7b4-dba05dba6fe5 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:42.776081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420975d-b69a-43e1-b7b4-dba05dba6fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:42.776081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420975d-b69a-43e1-b7b4-dba05dba6fe5 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:42.777902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 694/1373] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:29:42.785961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd574ae-dc14-4190-9366-3293016ab9f5 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:42.786519 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd574ae-dc14-4190-9366-3293016ab9f5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:42.786519 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd574ae-dc14-4190-9366-3293016ab9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:42.817274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-0cd574ae-dc14-4190-9366-3293016ab9f5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:42.818518 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0cd574ae-dc14-4190-9366-3293016ab9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:42.826894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 680/1374] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:42.881438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed289a-c009-4dea-a11b-7b61a367b977 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:42.881962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed289a-c009-4dea-a11b-7b61a367b977 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:42.882670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed289a-c009-4dea-a11b-7b61a367b977 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:42.885705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 695/1375] 10.222.0.83 () {54 vars in 963 bytes} [Wed Dec 15 13:29:42 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:42.894869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bea65-ce09-4cd4-8c80-2d4b7f4e58e2 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:42.895151 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bea65-ce09-4cd4-8c80-2d4b7f4e58e2 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:42.895792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bea65-ce09-4cd4-8c80-2d4b7f4e58e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:42.963594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-7e2bea65-ce09-4cd4-8c80-2d4b7f4e58e2 None None] MFA Rules not processed for user `63a5db2990424915ac1daf36d14a733b`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:42.964871 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7e2bea65-ce09-4cd4-8c80-2d4b7f4e58e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:43.038665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 681/1376] 10.222.0.83 () {58 vars in 1060 bytes} [Wed Dec 15 13:29:42 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:43.046798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed289a-c009-4dea-a11b-7b61a367b977 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:43.058440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed289a-c009-4dea-a11b-7b61a367b977 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:43.063345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c495c-f4af-4184-a892-25b5c38fbe80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:43.064156 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c495c-f4af-4184-a892-25b5c38fbe80 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:43.064530 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c495c-f4af-4184-a892-25b5c38fbe80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:43.064716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c495c-f4af-4184-a892-25b5c38fbe80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:43.076827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c495c-f4af-4184-a892-25b5c38fbe80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:43.078417 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c495c-f4af-4184-a892-25b5c38fbe80 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:43.090730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 696/1377] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:43.218232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073034a-04ea-45f6-98ea-8ce8fbd8fafd None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:43.218475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073034a-04ea-45f6-98ea-8ce8fbd8fafd None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:43.218667 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073034a-04ea-45f6-98ea-8ce8fbd8fafd None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:43.222616 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 682/1378] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:29:43.226435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755f533-5f92-4c0d-bf6e-3ba74d6ba708 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:43.226823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755f533-5f92-4c0d-bf6e-3ba74d6ba708 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:43.227019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755f533-5f92-4c0d-bf6e-3ba74d6ba708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:43.250560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5755f533-5f92-4c0d-bf6e-3ba74d6ba708 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:43.251999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5755f533-5f92-4c0d-bf6e-3ba74d6ba708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:43.270644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 697/1379] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:29:43.312559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073034a-04ea-45f6-98ea-8ce8fbd8fafd None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:43.332883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073034a-04ea-45f6-98ea-8ce8fbd8fafd None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:43.338268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7344e-ecfc-4685-9d6e-b9c5d6c96c6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:43.338909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7344e-ecfc-4685-9d6e-b9c5d6c96c6f service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:43.339186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7344e-ecfc-4685-9d6e-b9c5d6c96c6f service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:43.339460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7344e-ecfc-4685-9d6e-b9c5d6c96c6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:43.348874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7344e-ecfc-4685-9d6e-b9c5d6c96c6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:43.350488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7344e-ecfc-4685-9d6e-b9c5d6c96c6f service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:43.360492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 683/1380] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:45.858948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbdb41-b3b1-4763-b698-55ebf7ce37ca None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:45.859474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbdb41-b3b1-4763-b698-55ebf7ce37ca None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:45.859578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbdb41-b3b1-4763-b698-55ebf7ce37ca None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:45.861265 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 698/1381] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:29:45.867417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e9f7b-c758-4672-8581-6dc4a1c8d00e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:45.867868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e9f7b-c758-4672-8581-6dc4a1c8d00e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:45.867980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e9f7b-c758-4672-8581-6dc4a1c8d00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:45.886251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-337e9f7b-c758-4672-8581-6dc4a1c8d00e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:45.887441 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-337e9f7b-c758-4672-8581-6dc4a1c8d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:45.896052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 684/1382] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:45.943403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbdb41-b3b1-4763-b698-55ebf7ce37ca None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:45.959526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbdb41-b3b1-4763-b698-55ebf7ce37ca None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:45.965161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d58d98-da9e-4948-a104-67e4434b9cea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:45.965822 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d58d98-da9e-4948-a104-67e4434b9cea service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:45.966107 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d58d98-da9e-4948-a104-67e4434b9cea service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:45.966403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d58d98-da9e-4948-a104-67e4434b9cea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:45.974901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d58d98-da9e-4948-a104-67e4434b9cea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:45.976492 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d58d98-da9e-4948-a104-67e4434b9cea service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:45.985861 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 699/1383] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:48.559785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ba32-0b42-4e6b-a3c2-1781e5bf2c61 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:48.560457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ba32-0b42-4e6b-a3c2-1781e5bf2c61 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:48.560457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ba32-0b42-4e6b-a3c2-1781e5bf2c61 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:48.562134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 685/1384] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:48.568767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ade72-394a-43b4-b41a-95fe7e8e3860 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:48.569192 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ade72-394a-43b4-b41a-95fe7e8e3860 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:48.569315 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ade72-394a-43b4-b41a-95fe7e8e3860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:48.587643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-cc0ade72-394a-43b4-b41a-95fe7e8e3860 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:48.588812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-cc0ade72-394a-43b4-b41a-95fe7e8e3860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:48.596826 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 700/1385] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:29:48.645004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9ba32-0b42-4e6b-a3c2-1781e5bf2c61 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:48.664502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9ba32-0b42-4e6b-a3c2-1781e5bf2c61 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:48.670667 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ec74e-2747-4b1e-a638-0c47b11ccb8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:48.671490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec74e-2747-4b1e-a638-0c47b11ccb8f service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:48.671911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec74e-2747-4b1e-a638-0c47b11ccb8f service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:48.672337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec74e-2747-4b1e-a638-0c47b11ccb8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:48.682190 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ec74e-2747-4b1e-a638-0c47b11ccb8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:48.683929 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ec74e-2747-4b1e-a638-0c47b11ccb8f service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:48.695160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 686/1386] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:51.134881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f12c86-4598-43eb-b4ee-355c6a4ed2e5 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:51.135566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f12c86-4598-43eb-b4ee-355c6a4ed2e5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:51.135566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f12c86-4598-43eb-b4ee-355c6a4ed2e5 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:51.137242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 701/1387] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:29:51.143220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946952-76e3-4881-8f73-b83af4df00a8 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:51.143639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946952-76e3-4881-8f73-b83af4df00a8 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:51.143824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946952-76e3-4881-8f73-b83af4df00a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:51.162637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-4a946952-76e3-4881-8f73-b83af4df00a8 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:51.163839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4a946952-76e3-4881-8f73-b83af4df00a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:51.172039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 687/1388] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:51.217191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f12c86-4598-43eb-b4ee-355c6a4ed2e5 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:51.235885 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f12c86-4598-43eb-b4ee-355c6a4ed2e5 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:51.243357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09a626-ad82-49ff-ad18-fc227454ea55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:51.244165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a626-ad82-49ff-ad18-fc227454ea55 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:51.244785 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a626-ad82-49ff-ad18-fc227454ea55 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:51.245162 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a626-ad82-49ff-ad18-fc227454ea55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:51.255419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09a626-ad82-49ff-ad18-fc227454ea55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:51.256990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09a626-ad82-49ff-ad18-fc227454ea55 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:51.266422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 702/1389] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:53.898500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e164cd-b732-4cb7-9e14-23165efe6504 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:53.899039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e164cd-b732-4cb7-9e14-23165efe6504 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:53.899210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e164cd-b732-4cb7-9e14-23165efe6504 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:53.901234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 688/1390] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:53.908195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0025af-6732-4c1d-b6fa-740b02991056 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:53.908657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0025af-6732-4c1d-b6fa-740b02991056 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:53.908657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0025af-6732-4c1d-b6fa-740b02991056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:53.926997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-ca0025af-6732-4c1d-b6fa-740b02991056 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:53.928181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ca0025af-6732-4c1d-b6fa-740b02991056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:53.935995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 703/1391] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:53.990637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e164cd-b732-4cb7-9e14-23165efe6504 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:54.005843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e164cd-b732-4cb7-9e14-23165efe6504 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:54.011950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1ffe5-c503-4b37-886f-403e8c208fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:54.012632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ffe5-c503-4b37-886f-403e8c208fc3 service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:54.012925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ffe5-c503-4b37-886f-403e8c208fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:54.013210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ffe5-c503-4b37-886f-403e8c208fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:54.022264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1ffe5-c503-4b37-886f-403e8c208fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:54.023911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1ffe5-c503-4b37-886f-403e8c208fc3 service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:54.034721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 689/1392] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:56.421970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a5775-15ce-495f-8149-30b2781a51a8 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:56.422492 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a5775-15ce-495f-8149-30b2781a51a8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:56.422492 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a5775-15ce-495f-8149-30b2781a51a8 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:56.424256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 704/1393] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:56.430274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4fb5-0b86-4a00-8be0-f1de7ae384c4 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:56.430731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4fb5-0b86-4a00-8be0-f1de7ae384c4 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:56.430821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4fb5-0b86-4a00-8be0-f1de7ae384c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:56.454925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-924e4fb5-0b86-4a00-8be0-f1de7ae384c4 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:56.456678 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-924e4fb5-0b86-4a00-8be0-f1de7ae384c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:56.464489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 690/1394] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:56.512926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a5775-15ce-495f-8149-30b2781a51a8 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:56.531985 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a5775-15ce-495f-8149-30b2781a51a8 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:56.537597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04960b50-8229-4052-9674-2d16fb6e1084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:56.538317 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960b50-8229-4052-9674-2d16fb6e1084 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:56.538597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960b50-8229-4052-9674-2d16fb6e1084 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:56.538871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960b50-8229-4052-9674-2d16fb6e1084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:56.547710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04960b50-8229-4052-9674-2d16fb6e1084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:56.549322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04960b50-8229-4052-9674-2d16fb6e1084 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:56.559013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 705/1395] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:58.644923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba4c0-eb52-4240-aa04-f1c13e744012 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:58.645457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba4c0-eb52-4240-aa04-f1c13e744012 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:58.645545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba4c0-eb52-4240-aa04-f1c13e744012 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:58.647350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 691/1396] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:58.653206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d62f5-9825-4d40-89bd-720ad8d8d4ff None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:58.653704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d62f5-9825-4d40-89bd-720ad8d8d4ff None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:58.653883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d62f5-9825-4d40-89bd-720ad8d8d4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:58.672582 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d21d62f5-9825-4d40-89bd-720ad8d8d4ff None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:58.673801 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d21d62f5-9825-4d40-89bd-720ad8d8d4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:58.682272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 706/1397] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:58.740722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0670fa3-0c55-4115-88b6-b07aca3a08d4 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:58.741004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0670fa3-0c55-4115-88b6-b07aca3a08d4 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:58.741281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0670fa3-0c55-4115-88b6-b07aca3a08d4 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:58.743104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 692/1398] 10.222.0.83 () {54 vars in 962 bytes} [Wed Dec 15 13:29:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:58.748630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54afdde-c900-45ed-8ce8-31a5b403de54 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:58.748919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54afdde-c900-45ed-8ce8-31a5b403de54 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:58.749194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54afdde-c900-45ed-8ce8-31a5b403de54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:58.797487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d54afdde-c900-45ed-8ce8-31a5b403de54 None None] MFA Rules not processed for user `80ddafedf2734326832ab4bf620f7634`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:58.798720 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d54afdde-c900-45ed-8ce8-31a5b403de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:58.858528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 707/1399] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Dec 15 13:29:58 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:58.867064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0670fa3-0c55-4115-88b6-b07aca3a08d4 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:58.877785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0670fa3-0c55-4115-88b6-b07aca3a08d4 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:58.881318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924e959-ebd9-4b9f-b8b1-101ccd28b7fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ddafedf2734326832ab4bf620f7634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:58.881986 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e959-ebd9-4b9f-b8b1-101ccd28b7fa service glance] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:58.882272 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e959-ebd9-4b9f-b8b1-101ccd28b7fa service glance] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:58.882548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e959-ebd9-4b9f-b8b1-101ccd28b7fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:58.891479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924e959-ebd9-4b9f-b8b1-101ccd28b7fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:58.893449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924e959-ebd9-4b9f-b8b1-101ccd28b7fa service glance] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:58.902885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 693/1400] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:58.950639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358f8eb-f35d-469d-98e1-8f32dd2a9ec3 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:58.951037 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358f8eb-f35d-469d-98e1-8f32dd2a9ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:58.951321 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358f8eb-f35d-469d-98e1-8f32dd2a9ec3 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:58.953066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 708/1401] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:29:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:58.959605 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba53ade-c5de-4bfe-bcda-ee042fda74ba None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:58.959891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba53ade-c5de-4bfe-bcda-ee042fda74ba None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:58.960167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba53ade-c5de-4bfe-bcda-ee042fda74ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:58.978686 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-8ba53ade-c5de-4bfe-bcda-ee042fda74ba None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:58.979841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8ba53ade-c5de-4bfe-bcda-ee042fda74ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:58.990043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 694/1402] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:29:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:29:59.037234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358f8eb-f35d-469d-98e1-8f32dd2a9ec3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:59.053001 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358f8eb-f35d-469d-98e1-8f32dd2a9ec3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:59.058911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e76776-7cd2-4f09-9c41-5b68b1e3cb90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:59.059590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e76776-7cd2-4f09-9c41-5b68b1e3cb90 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:59.059871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e76776-7cd2-4f09-9c41-5b68b1e3cb90 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:59.060314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e76776-7cd2-4f09-9c41-5b68b1e3cb90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:59.069337 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e76776-7cd2-4f09-9c41-5b68b1e3cb90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:59.070835 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e76776-7cd2-4f09-9c41-5b68b1e3cb90 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:59.081172 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 709/1403] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:29:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:29:59.380887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c0390-6a6b-4245-8ecd-929fe315373b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:59.381271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c0390-6a6b-4245-8ecd-929fe315373b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:59.381615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c0390-6a6b-4245-8ecd-929fe315373b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:59.433849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-af5c0390-6a6b-4245-8ecd-929fe315373b None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:59.435042 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-af5c0390-6a6b-4245-8ecd-929fe315373b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:59.498009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 695/1404] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:29:59 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:59.549181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c731b-d6cf-463c-85d2-6e0e1f1e3f41 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:59.549181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c731b-d6cf-463c-85d2-6e0e1f1e3f41 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:59.549181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c731b-d6cf-463c-85d2-6e0e1f1e3f41 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:59.552970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 710/1405] 10.222.0.83 () {54 vars in 942 bytes} [Wed Dec 15 13:29:59 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:29:59.561730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1ca9-acf8-40d9-97e5-95d0ac473b98 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:59.562396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1ca9-acf8-40d9-97e5-95d0ac473b98 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:59.562918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1ca9-acf8-40d9-97e5-95d0ac473b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:59.616340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b35f1ca9-acf8-40d9-97e5-95d0ac473b98 None None] MFA Rules not processed for user `93ec8ea8a0904d30b6a95c8ebc9dd634`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:29:59.617560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b35f1ca9-acf8-40d9-97e5-95d0ac473b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:29:59.693749 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 696/1406] 10.222.0.83 () {58 vars in 1039 bytes} [Wed Dec 15 13:29:59 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:29:59.703215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c731b-d6cf-463c-85d2-6e0e1f1e3f41 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:29:59.717046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c731b-d6cf-463c-85d2-6e0e1f1e3f41 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:29:59.722517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287253d-2b83-46d2-ac73-d5405c5c6036 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:29:59.723239 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287253d-2b83-46d2-ac73-d5405c5c6036 service swift] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:29:59.723521 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287253d-2b83-46d2-ac73-d5405c5c6036 service swift] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:29:59.723792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287253d-2b83-46d2-ac73-d5405c5c6036 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:29:59.731582 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287253d-2b83-46d2-ac73-d5405c5c6036 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:29:59.733158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287253d-2b83-46d2-ac73-d5405c5c6036 service swift] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:29:59.741432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 711/1407] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:29:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:30:01.518961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489ee2b-6118-4eff-a591-fa5b136f610e None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:01.519477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489ee2b-6118-4eff-a591-fa5b136f610e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:01.519556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489ee2b-6118-4eff-a591-fa5b136f610e None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:01.524282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 697/1408] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:30:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:30:01.530599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51db7a-6264-4a2e-bd27-5afa3cb79d86 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:01.531089 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51db7a-6264-4a2e-bd27-5afa3cb79d86 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:01.531184 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51db7a-6264-4a2e-bd27-5afa3cb79d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:01.550758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-7b51db7a-6264-4a2e-bd27-5afa3cb79d86 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:01.552294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7b51db7a-6264-4a2e-bd27-5afa3cb79d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:01.563609 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 712/1409] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:30:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:01.612590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489ee2b-6118-4eff-a591-fa5b136f610e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:01.631090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489ee2b-6118-4eff-a591-fa5b136f610e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:01.636653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09142a43-263a-440c-9208-8bd0de546130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:01.637301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09142a43-263a-440c-9208-8bd0de546130 service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:01.637580 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09142a43-263a-440c-9208-8bd0de546130 service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:01.637885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09142a43-263a-440c-9208-8bd0de546130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:01.646551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09142a43-263a-440c-9208-8bd0de546130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:01.648111 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09142a43-263a-440c-9208-8bd0de546130 service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:01.659443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 698/1410] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:04.213831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12396-0741-4ecc-b098-6e260ade715e None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:04.214422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12396-0741-4ecc-b098-6e260ade715e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:04.214618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12396-0741-4ecc-b098-6e260ade715e None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:04.217344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 713/1411] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:30:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:04.224000 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9935a6-31d9-4a9d-b5ad-36fb81833e5c None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:04.224507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9935a6-31d9-4a9d-b5ad-36fb81833e5c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:04.224597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9935a6-31d9-4a9d-b5ad-36fb81833e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:04.244984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-ac9935a6-31d9-4a9d-b5ad-36fb81833e5c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:04.246224 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ac9935a6-31d9-4a9d-b5ad-36fb81833e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:04.258821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 699/1412] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:30:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:04.310474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12396-0741-4ecc-b098-6e260ade715e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:04.327657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12396-0741-4ecc-b098-6e260ade715e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:04.332247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edb354-798b-4d44-abb1-95ca50e59e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:04.332898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edb354-798b-4d44-abb1-95ca50e59e45 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:04.333180 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edb354-798b-4d44-abb1-95ca50e59e45 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:04.333454 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edb354-798b-4d44-abb1-95ca50e59e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:04.342296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edb354-798b-4d44-abb1-95ca50e59e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:04.343865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edb354-798b-4d44-abb1-95ca50e59e45 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:04.358093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 714/1413] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:22.903749 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b8f21-61a7-470d-ad3e-1e2dd2766c49 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:22.904369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b8f21-61a7-470d-ad3e-1e2dd2766c49 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:22.904369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b8f21-61a7-470d-ad3e-1e2dd2766c49 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:22.906156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 700/1414] 10.222.0.83 () {54 vars in 918 bytes} [Wed Dec 15 13:30:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:22.911839 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef60b9-3633-4a04-a917-3fe6ae40c0d9 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:22.912289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef60b9-3633-4a04-a917-3fe6ae40c0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:22.912400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef60b9-3633-4a04-a917-3fe6ae40c0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:22.931155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2cef60b9-3633-4a04-a917-3fe6ae40c0d9 None None] MFA Rules not processed for user `797b1d42ac3a427bb084740a069b577d`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:22.932341 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2cef60b9-3633-4a04-a917-3fe6ae40c0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:22.941409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 715/1415] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Dec 15 13:30:22 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:22.956973 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e46a-1b3c-4530-945d-b6cd4c393e5c None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:22.957283 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e46a-1b3c-4530-945d-b6cd4c393e5c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:22.957552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e46a-1b3c-4530-945d-b6cd4c393e5c None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:22.959334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 701/1416] 10.222.0.83 () {54 vars in 918 bytes} [Wed Dec 15 13:30:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:22.964312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3d8c2-c931-4331-914f-e335e44ab964 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:22.964603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3d8c2-c931-4331-914f-e335e44ab964 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:22.964918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3d8c2-c931-4331-914f-e335e44ab964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:22.982409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-21e3d8c2-c931-4331-914f-e335e44ab964 None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:22.983596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-21e3d8c2-c931-4331-914f-e335e44ab964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:22.993142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 716/1417] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Dec 15 13:30:22 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:25.753492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385af84-3452-4fd0-bc88-ea1bf5f27289 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:25.754101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385af84-3452-4fd0-bc88-ea1bf5f27289 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:25.754101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385af84-3452-4fd0-bc88-ea1bf5f27289 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:25.755853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 702/1418] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:30:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:25.761812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b0ed-560b-46d0-90b1-1b710bd705a5 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:25.762227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b0ed-560b-46d0-90b1-1b710bd705a5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:25.762438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b0ed-560b-46d0-90b1-1b710bd705a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:25.780443 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-34d8b0ed-560b-46d0-90b1-1b710bd705a5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:25.781622 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-34d8b0ed-560b-46d0-90b1-1b710bd705a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:25.789275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 717/1419] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:30:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:25.833737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385af84-3452-4fd0-bc88-ea1bf5f27289 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:25.847669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385af84-3452-4fd0-bc88-ea1bf5f27289 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:25.853106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f0ba4-ae36-47e6-86ee-5429fe12dd1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:25.853728 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f0ba4-ae36-47e6-86ee-5429fe12dd1b service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:25.854032 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f0ba4-ae36-47e6-86ee-5429fe12dd1b service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:25.854308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f0ba4-ae36-47e6-86ee-5429fe12dd1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:25.862627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f0ba4-ae36-47e6-86ee-5429fe12dd1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:25.864186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f0ba4-ae36-47e6-86ee-5429fe12dd1b service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:25.873208 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 703/1420] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:27.456147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638ec1-4102-4d1d-920a-aa8a05e00c03 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:27.456730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638ec1-4102-4d1d-920a-aa8a05e00c03 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:27.456730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638ec1-4102-4d1d-920a-aa8a05e00c03 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:27.458491 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 718/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:30:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:30:27.464212 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f44a58-27c7-418e-9467-39160596f070 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:27.464782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f44a58-27c7-418e-9467-39160596f070 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:27.464782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f44a58-27c7-418e-9467-39160596f070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:27.482340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b8f44a58-27c7-418e-9467-39160596f070 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:27.484037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b8f44a58-27c7-418e-9467-39160596f070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:27.491852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 704/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:30:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:30:27.646500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89638ec1-4102-4d1d-920a-aa8a05e00c03 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:27.663176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89638ec1-4102-4d1d-920a-aa8a05e00c03 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:27.668635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9aa6fb-3928-41a1-b99f-e1a7fc068d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:27.669306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa6fb-3928-41a1-b99f-e1a7fc068d3a service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:27.669575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa6fb-3928-41a1-b99f-e1a7fc068d3a service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:27.669877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa6fb-3928-41a1-b99f-e1a7fc068d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:27.678984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aa6fb-3928-41a1-b99f-e1a7fc068d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:27.680571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aa6fb-3928-41a1-b99f-e1a7fc068d3a service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:27.690569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 719/1423] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:29.225729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fd7fc-fe0b-47bc-b964-ce619d4d5655 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:29.226318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fd7fc-fe0b-47bc-b964-ce619d4d5655 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:29.226318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fd7fc-fe0b-47bc-b964-ce619d4d5655 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:29.228087 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 705/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:30:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:29.233504 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650bf3-54c6-422d-a45f-a54f01b5c0b2 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:29.233961 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650bf3-54c6-422d-a45f-a54f01b5c0b2 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:29.234065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650bf3-54c6-422d-a45f-a54f01b5c0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:29.252517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5d650bf3-54c6-422d-a45f-a54f01b5c0b2 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:29.253703 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5d650bf3-54c6-422d-a45f-a54f01b5c0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:29.261303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 720/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:30:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:29.411559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fd7fc-fe0b-47bc-b964-ce619d4d5655 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:29.428376 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fd7fc-fe0b-47bc-b964-ce619d4d5655 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:29.436592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54565b-0b9f-467f-bc67-e71ee672faf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:29.437526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54565b-0b9f-467f-bc67-e71ee672faf6 service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:29.438009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54565b-0b9f-467f-bc67-e71ee672faf6 service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:29.438427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54565b-0b9f-467f-bc67-e71ee672faf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:29.450464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54565b-0b9f-467f-bc67-e71ee672faf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:29.453810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54565b-0b9f-467f-bc67-e71ee672faf6 service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:29.465866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 706/1426] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:30.998793 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca65958-43a2-4246-828c-8731362f9454 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:30.999324 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca65958-43a2-4246-828c-8731362f9454 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:30.999324 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca65958-43a2-4246-828c-8731362f9454 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:31.001059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 721/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:30:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:31.007387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34f61-db38-4ad9-aba5-8182208d4cdb None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:31.008284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34f61-db38-4ad9-aba5-8182208d4cdb None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:31.008284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34f61-db38-4ad9-aba5-8182208d4cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:31.028617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-40c34f61-db38-4ad9-aba5-8182208d4cdb None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:31.030369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-40c34f61-db38-4ad9-aba5-8182208d4cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:31.041801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 707/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:30:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:31.196648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca65958-43a2-4246-828c-8731362f9454 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:31.213107 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca65958-43a2-4246-828c-8731362f9454 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:31.219787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d80dfe-437b-4c72-8874-b167b389eee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:31.220775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80dfe-437b-4c72-8874-b167b389eee8 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:31.221178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80dfe-437b-4c72-8874-b167b389eee8 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:31.221600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80dfe-437b-4c72-8874-b167b389eee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:31.236707 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d80dfe-437b-4c72-8874-b167b389eee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:31.238351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d80dfe-437b-4c72-8874-b167b389eee8 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:31.248947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 722/1429] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:32.808089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd92f7-a146-438f-a2b1-8a1b26897f50 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:32.808654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd92f7-a146-438f-a2b1-8a1b26897f50 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:32.808654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd92f7-a146-438f-a2b1-8a1b26897f50 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:32.810631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 708/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:30:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:30:32.816684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ab469-fb4f-4102-b622-a7f7c2370fde None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:32.817207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ab469-fb4f-4102-b622-a7f7c2370fde None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:32.817320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ab469-fb4f-4102-b622-a7f7c2370fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:32.838457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-cc4ab469-fb4f-4102-b622-a7f7c2370fde None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:32.839710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-cc4ab469-fb4f-4102-b622-a7f7c2370fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:32.848549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 723/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:30:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:33.005138 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd92f7-a146-438f-a2b1-8a1b26897f50 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:33.020644 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd92f7-a146-438f-a2b1-8a1b26897f50 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:33.026858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c0c0d-e554-4021-83fd-60ab2fc1220a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:33.027514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c0c0d-e554-4021-83fd-60ab2fc1220a service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:33.027789 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c0c0d-e554-4021-83fd-60ab2fc1220a service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:33.028060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c0c0d-e554-4021-83fd-60ab2fc1220a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:33.036755 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c0c0d-e554-4021-83fd-60ab2fc1220a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:33.038614 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c0c0d-e554-4021-83fd-60ab2fc1220a service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:33.048260 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 709/1432] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:34.555798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdbd00-d64a-4d55-8eac-49a5b6344e64 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:34.556349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdbd00-d64a-4d55-8eac-49a5b6344e64 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:34.556349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdbd00-d64a-4d55-8eac-49a5b6344e64 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:34.558194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 724/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:30:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:34.564060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9607-b52d-4dc5-8aaa-4b0fbc5eb9d2 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:34.564691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9607-b52d-4dc5-8aaa-4b0fbc5eb9d2 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:34.564691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9607-b52d-4dc5-8aaa-4b0fbc5eb9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:34.583557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-bd0a9607-b52d-4dc5-8aaa-4b0fbc5eb9d2 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:34.584748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-bd0a9607-b52d-4dc5-8aaa-4b0fbc5eb9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:34.593337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 710/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:30:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:34.748453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdbd00-d64a-4d55-8eac-49a5b6344e64 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:34.763816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdbd00-d64a-4d55-8eac-49a5b6344e64 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:34.769345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70f501-775b-4a30-83b4-3e3ce9dd2586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:34.770143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f501-775b-4a30-83b4-3e3ce9dd2586 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:34.770426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f501-775b-4a30-83b4-3e3ce9dd2586 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:34.770702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f501-775b-4a30-83b4-3e3ce9dd2586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:34.780171 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70f501-775b-4a30-83b4-3e3ce9dd2586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:34.781776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70f501-775b-4a30-83b4-3e3ce9dd2586 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:34.797786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 725/1435] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:36.317032 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f1190-1497-4c49-9f4f-b94e8b011fe5 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:36.317695 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f1190-1497-4c49-9f4f-b94e8b011fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:36.317695 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f1190-1497-4c49-9f4f-b94e8b011fe5 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:36.319411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 711/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:30:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:30:36.329318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c00ab-b425-4cd1-a1ae-5070a4feded2 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:36.329891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c00ab-b425-4cd1-a1ae-5070a4feded2 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:36.330377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c00ab-b425-4cd1-a1ae-5070a4feded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:36.351985 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-b43c00ab-b425-4cd1-a1ae-5070a4feded2 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:36.353722 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b43c00ab-b425-4cd1-a1ae-5070a4feded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:36.364329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 726/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:30:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:36.521663 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f1190-1497-4c49-9f4f-b94e8b011fe5 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:36.536629 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f1190-1497-4c49-9f4f-b94e8b011fe5 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:36.542102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5870d71-a259-4277-9124-295f3f730007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:36.542766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5870d71-a259-4277-9124-295f3f730007 service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:36.543069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5870d71-a259-4277-9124-295f3f730007 service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:36.543341 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5870d71-a259-4277-9124-295f3f730007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:36.552986 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5870d71-a259-4277-9124-295f3f730007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:36.554824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5870d71-a259-4277-9124-295f3f730007 service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:36.566194 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 712/1438] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:30:38.147813 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeb3ce-e0d5-4293-808f-36cb0c5699ec None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:38.148370 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeb3ce-e0d5-4293-808f-36cb0c5699ec None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:38.148370 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eeb3ce-e0d5-4293-808f-36cb0c5699ec None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:38.150420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 727/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:30:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:38.159725 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834938ec-26da-42f5-a543-6bb348fd4978 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:38.160150 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834938ec-26da-42f5-a543-6bb348fd4978 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:38.160602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834938ec-26da-42f5-a543-6bb348fd4978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:38.180131 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-834938ec-26da-42f5-a543-6bb348fd4978 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:38.181381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-834938ec-26da-42f5-a543-6bb348fd4978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:38.189962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 713/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:30:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:38.343478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeb3ce-e0d5-4293-808f-36cb0c5699ec None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:38.358090 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eeb3ce-e0d5-4293-808f-36cb0c5699ec None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:38.363499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50dc6-9dc3-4789-85d6-eaeed896fee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:38.364128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50dc6-9dc3-4789-85d6-eaeed896fee6 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:38.364406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50dc6-9dc3-4789-85d6-eaeed896fee6 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:38.364678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50dc6-9dc3-4789-85d6-eaeed896fee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:38.373461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50dc6-9dc3-4789-85d6-eaeed896fee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:38.375079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50dc6-9dc3-4789-85d6-eaeed896fee6 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:38.384603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 728/1441] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:39.877072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ac863-b5db-4b64-8157-0bf051275b1a None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:39.877640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ac863-b5db-4b64-8157-0bf051275b1a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:39.877640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ac863-b5db-4b64-8157-0bf051275b1a None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:39.879456 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 714/1442] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:30:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:39.885494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3293d-62c0-4413-b42c-60666421e0c5 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:39.886357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3293d-62c0-4413-b42c-60666421e0c5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:39.886357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3293d-62c0-4413-b42c-60666421e0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:39.904847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-34b3293d-62c0-4413-b42c-60666421e0c5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:39.906243 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-34b3293d-62c0-4413-b42c-60666421e0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:39.914514 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 729/1443] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:30:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:30:40.069980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ac863-b5db-4b64-8157-0bf051275b1a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:40.095012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ac863-b5db-4b64-8157-0bf051275b1a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:40.100814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec6dac-65a1-4d15-8f23-49e93490d5ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:40.101464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6dac-65a1-4d15-8f23-49e93490d5ae service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:40.101744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6dac-65a1-4d15-8f23-49e93490d5ae service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:40.102046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6dac-65a1-4d15-8f23-49e93490d5ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:40.110989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec6dac-65a1-4d15-8f23-49e93490d5ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:40.112579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec6dac-65a1-4d15-8f23-49e93490d5ae service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:40.122725 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 715/1444] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:42.391355 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c0075-0d52-4021-9c15-2579b816ee77 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:42.391954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c0075-0d52-4021-9c15-2579b816ee77 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:42.391954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c0075-0d52-4021-9c15-2579b816ee77 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:42.393629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 730/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:30:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:42.399847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a07a91-f925-4b7a-a32f-f52383e6640f None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:42.400405 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a07a91-f925-4b7a-a32f-f52383e6640f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:42.400405 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a07a91-f925-4b7a-a32f-f52383e6640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:42.418902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c5a07a91-f925-4b7a-a32f-f52383e6640f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:42.420110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c5a07a91-f925-4b7a-a32f-f52383e6640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:42.427822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 716/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:30:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:42.469459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c0075-0d52-4021-9c15-2579b816ee77 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:42.479976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c0075-0d52-4021-9c15-2579b816ee77 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:42.483652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2773e-012f-45f8-b516-027730b517ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:42.484291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2773e-012f-45f8-b516-027730b517ea service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:42.484570 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2773e-012f-45f8-b516-027730b517ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:42.484843 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2773e-012f-45f8-b516-027730b517ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:42.493653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2773e-012f-45f8-b516-027730b517ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:42.495097 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2773e-012f-45f8-b516-027730b517ea service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:42.504260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 731/1447] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:45.002984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b3c05-65ac-4985-b4fa-db590f6b1bf1 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:45.003495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b3c05-65ac-4985-b4fa-db590f6b1bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:45.003495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b3c05-65ac-4985-b4fa-db590f6b1bf1 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:45.005214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 717/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:30:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:45.011081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0e2f9-13c9-478c-9d4b-4218207f799a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:45.011480 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0e2f9-13c9-478c-9d4b-4218207f799a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:45.011631 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0e2f9-13c9-478c-9d4b-4218207f799a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:45.029422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-b0c0e2f9-13c9-478c-9d4b-4218207f799a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:45.030642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b0c0e2f9-13c9-478c-9d4b-4218207f799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:45.038320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 732/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:30:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:45.077599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b3c05-65ac-4985-b4fa-db590f6b1bf1 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:45.088207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b3c05-65ac-4985-b4fa-db590f6b1bf1 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:45.091665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea37d7d-4f8d-4eca-a0c1-61f0c4c1b601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:45.092311 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea37d7d-4f8d-4eca-a0c1-61f0c4c1b601 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:45.092586 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea37d7d-4f8d-4eca-a0c1-61f0c4c1b601 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:45.092854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea37d7d-4f8d-4eca-a0c1-61f0c4c1b601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:45.101329 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea37d7d-4f8d-4eca-a0c1-61f0c4c1b601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:45.102775 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea37d7d-4f8d-4eca-a0c1-61f0c4c1b601 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:45.112730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 718/1450] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:47.765498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822f3e-6e5e-4722-b39b-02424fe6d7f5 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:47.766089 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822f3e-6e5e-4722-b39b-02424fe6d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:47.766089 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822f3e-6e5e-4722-b39b-02424fe6d7f5 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:47.767842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 733/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:30:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:47.773906 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6918a-f32f-43a3-9079-fd7b32d01897 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:47.774539 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6918a-f32f-43a3-9079-fd7b32d01897 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:47.774539 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6918a-f32f-43a3-9079-fd7b32d01897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:47.792736 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-89f6918a-f32f-43a3-9079-fd7b32d01897 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:47.794139 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-89f6918a-f32f-43a3-9079-fd7b32d01897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:47.801976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 719/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:30:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:47.843702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9822f3e-6e5e-4722-b39b-02424fe6d7f5 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:47.854263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9822f3e-6e5e-4722-b39b-02424fe6d7f5 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:47.857859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23eab4-c9e0-4223-8fef-6a2ee31eca2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:47.858494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23eab4-c9e0-4223-8fef-6a2ee31eca2d service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:47.858776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23eab4-c9e0-4223-8fef-6a2ee31eca2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:47.859051 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23eab4-c9e0-4223-8fef-6a2ee31eca2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:47.868126 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23eab4-c9e0-4223-8fef-6a2ee31eca2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:47.869542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23eab4-c9e0-4223-8fef-6a2ee31eca2d service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:47.879489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 734/1453] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:50.458913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05667642-3522-4b8e-a8f5-c7c4d44a1001 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:50.459526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05667642-3522-4b8e-a8f5-c7c4d44a1001 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:50.459747 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05667642-3522-4b8e-a8f5-c7c4d44a1001 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:50.462584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 720/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:30:50 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:50.469303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edead6-7bdb-4fa1-a5e1-f10c4558d204 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:50.469733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edead6-7bdb-4fa1-a5e1-f10c4558d204 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:50.469889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edead6-7bdb-4fa1-a5e1-f10c4558d204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:50.493419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-49edead6-7bdb-4fa1-a5e1-f10c4558d204 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:50.495189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-49edead6-7bdb-4fa1-a5e1-f10c4558d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:50.506259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 735/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:30:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:50.548438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05667642-3522-4b8e-a8f5-c7c4d44a1001 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:50.559060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05667642-3522-4b8e-a8f5-c7c4d44a1001 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:50.562590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4904b-c965-4c15-9ae1-4c56c4d6f358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:50.563218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4904b-c965-4c15-9ae1-4c56c4d6f358 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:50.563493 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4904b-c965-4c15-9ae1-4c56c4d6f358 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:50.563766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4904b-c965-4c15-9ae1-4c56c4d6f358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:50.572635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4904b-c965-4c15-9ae1-4c56c4d6f358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:50.574127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4904b-c965-4c15-9ae1-4c56c4d6f358 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:50.583698 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 721/1456] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:52.995653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8418a-d4d4-4f8d-9366-32b8aca2b8fe None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:52.996178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8418a-d4d4-4f8d-9366-32b8aca2b8fe None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:52.996178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8418a-d4d4-4f8d-9366-32b8aca2b8fe None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:52.997959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 736/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:30:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:53.003883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacfe31-0372-4b6d-aa2a-4ab8e31576ab None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:53.004298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacfe31-0372-4b6d-aa2a-4ab8e31576ab None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:53.004469 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacfe31-0372-4b6d-aa2a-4ab8e31576ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:53.023094 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-7cacfe31-0372-4b6d-aa2a-4ab8e31576ab None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:53.024289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7cacfe31-0372-4b6d-aa2a-4ab8e31576ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:53.032672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 722/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:30:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:53.072789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8418a-d4d4-4f8d-9366-32b8aca2b8fe None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:53.084181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8418a-d4d4-4f8d-9366-32b8aca2b8fe None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:53.088031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a72f38-b1bb-4954-af28-b80f00bffc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:53.088676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a72f38-b1bb-4954-af28-b80f00bffc7a service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:53.088959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a72f38-b1bb-4954-af28-b80f00bffc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:53.089235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a72f38-b1bb-4954-af28-b80f00bffc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:53.099628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a72f38-b1bb-4954-af28-b80f00bffc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:53.101077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a72f38-b1bb-4954-af28-b80f00bffc7a service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:53.119321 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 737/1459] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:55.545707 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae694f-922a-4f09-b968-7b60b53217f3 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.546398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae694f-922a-4f09-b968-7b60b53217f3 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.546398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae694f-922a-4f09-b968-7b60b53217f3 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.548065 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 723/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:30:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:30:55.554677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408398b-f1ef-4dfa-8794-69255ed7ad0d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.554677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408398b-f1ef-4dfa-8794-69255ed7ad0d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.555217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408398b-f1ef-4dfa-8794-69255ed7ad0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.575252 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d408398b-f1ef-4dfa-8794-69255ed7ad0d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:55.576452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d408398b-f1ef-4dfa-8794-69255ed7ad0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:55.584387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 738/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:30:55.624357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae694f-922a-4f09-b968-7b60b53217f3 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:55.635413 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae694f-922a-4f09-b968-7b60b53217f3 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:55.639570 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc987294-7679-4662-9519-8fa807ade787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:55.640197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc987294-7679-4662-9519-8fa807ade787 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:55.640472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc987294-7679-4662-9519-8fa807ade787 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:55.640743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc987294-7679-4662-9519-8fa807ade787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:55.649676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc987294-7679-4662-9519-8fa807ade787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:55.651126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc987294-7679-4662-9519-8fa807ade787 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:55.660574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 724/1462] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:30:58.086456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6db39-0403-4b2f-b2f1-3901cc993bc0 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.086989 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6db39-0403-4b2f-b2f1-3901cc993bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.086989 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6db39-0403-4b2f-b2f1-3901cc993bc0 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.088643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 739/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:30:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:30:58.094959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00a8f-cabb-4e0f-8372-e38efbeaf00e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.095428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00a8f-cabb-4e0f-8372-e38efbeaf00e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.095534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00a8f-cabb-4e0f-8372-e38efbeaf00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.115061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b3b00a8f-cabb-4e0f-8372-e38efbeaf00e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:30:58.116261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b3b00a8f-cabb-4e0f-8372-e38efbeaf00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:30:58.124629 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 725/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:30:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:30:58.166864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6db39-0403-4b2f-b2f1-3901cc993bc0 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:30:58.178085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6db39-0403-4b2f-b2f1-3901cc993bc0 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:30:58.181614 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a27da-b803-4888-a789-9b69313d711b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:30:58.182286 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a27da-b803-4888-a789-9b69313d711b service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:30:58.182567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a27da-b803-4888-a789-9b69313d711b service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:30:58.182839 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a27da-b803-4888-a789-9b69313d711b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:30:58.192602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a27da-b803-4888-a789-9b69313d711b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:30:58.194203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a27da-b803-4888-a789-9b69313d711b service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:30:58.204158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 740/1465] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:30:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:00.630246 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc0dc-b713-4c4f-bddf-7e2d98bb9eb7 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:00.630833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc0dc-b713-4c4f-bddf-7e2d98bb9eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:00.630833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc0dc-b713-4c4f-bddf-7e2d98bb9eb7 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:00.632674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 726/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:31:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:00.639175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d5f5-d302-4156-86f2-f3e681f69039 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:00.639654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d5f5-d302-4156-86f2-f3e681f69039 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:00.639782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d5f5-d302-4156-86f2-f3e681f69039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:00.657713 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-7eb8d5f5-d302-4156-86f2-f3e681f69039 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:00.658944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7eb8d5f5-d302-4156-86f2-f3e681f69039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:00.666743 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 741/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:31:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:00.707699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fc0dc-b713-4c4f-bddf-7e2d98bb9eb7 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:00.718330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fc0dc-b713-4c4f-bddf-7e2d98bb9eb7 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:00.721807 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54806fe7-bc84-4a3e-a17a-a0add55fe030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:00.722440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54806fe7-bc84-4a3e-a17a-a0add55fe030 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:00.722717 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54806fe7-bc84-4a3e-a17a-a0add55fe030 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:00.722996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54806fe7-bc84-4a3e-a17a-a0add55fe030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:00.732268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54806fe7-bc84-4a3e-a17a-a0add55fe030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:00.733801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54806fe7-bc84-4a3e-a17a-a0add55fe030 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:00.743417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 727/1468] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:03.167483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156df0-76f4-496a-90bb-c0c65d51bdc5 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:03.168046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156df0-76f4-496a-90bb-c0c65d51bdc5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:03.168046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156df0-76f4-496a-90bb-c0c65d51bdc5 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:03.169857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 742/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:31:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:03.176302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629a9d-f2fe-49b7-8318-e3ced0541341 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:03.176735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629a9d-f2fe-49b7-8318-e3ced0541341 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:03.176843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629a9d-f2fe-49b7-8318-e3ced0541341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:03.196683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-95629a9d-f2fe-49b7-8318-e3ced0541341 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:03.197928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-95629a9d-f2fe-49b7-8318-e3ced0541341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:03.206671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 728/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:31:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:03.244616 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f156df0-76f4-496a-90bb-c0c65d51bdc5 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:03.255967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f156df0-76f4-496a-90bb-c0c65d51bdc5 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:03.259599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed0d2d-29a3-4e01-a191-2039ce3b130e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:03.260242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed0d2d-29a3-4e01-a191-2039ce3b130e service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:03.260534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed0d2d-29a3-4e01-a191-2039ce3b130e service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:03.260810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed0d2d-29a3-4e01-a191-2039ce3b130e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:03.270675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed0d2d-29a3-4e01-a191-2039ce3b130e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:03.272088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed0d2d-29a3-4e01-a191-2039ce3b130e service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:03.281770 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 743/1471] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:05.754163 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd49464-0fd0-46c6-9107-27ceea1baea9 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:05.754756 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd49464-0fd0-46c6-9107-27ceea1baea9 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:05.754756 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd49464-0fd0-46c6-9107-27ceea1baea9 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:05.756594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 729/1472] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:31:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:05.763175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef639657-64df-47ba-a375-ee0f75f9414a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:05.763624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef639657-64df-47ba-a375-ee0f75f9414a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:05.763727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef639657-64df-47ba-a375-ee0f75f9414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:05.781727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-ef639657-64df-47ba-a375-ee0f75f9414a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:05.782927 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ef639657-64df-47ba-a375-ee0f75f9414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:05.791089 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 744/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:31:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:05.829661 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd49464-0fd0-46c6-9107-27ceea1baea9 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:05.842611 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd49464-0fd0-46c6-9107-27ceea1baea9 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:05.846469 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb5f14-9a7f-4a8e-af00-84cea0300fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:05.847141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb5f14-9a7f-4a8e-af00-84cea0300fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:05.847419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb5f14-9a7f-4a8e-af00-84cea0300fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:05.847689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb5f14-9a7f-4a8e-af00-84cea0300fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:05.859403 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb5f14-9a7f-4a8e-af00-84cea0300fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:05.860818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb5f14-9a7f-4a8e-af00-84cea0300fc7 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:05.869871 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 730/1474] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:23.019942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20e4b-8228-4b36-8758-6c147eddd676 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.020470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20e4b-8228-4b36-8758-6c147eddd676 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.020470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20e4b-8228-4b36-8758-6c147eddd676 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.022407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 745/1475] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:31:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:23.028629 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4d77-25c3-46dc-841e-ff9692757f6b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.029120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4d77-25c3-46dc-841e-ff9692757f6b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.029291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4d77-25c3-46dc-841e-ff9692757f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.047364 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-addf4d77-25c3-46dc-841e-ff9692757f6b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:23.048863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-addf4d77-25c3-46dc-841e-ff9692757f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:23.057173 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 731/1476] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:31:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:23.105695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768691-b332-414e-806f-74d8e3451e14 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.106013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768691-b332-414e-806f-74d8e3451e14 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.106291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768691-b332-414e-806f-74d8e3451e14 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.108045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 746/1477] 10.222.0.83 () {54 vars in 962 bytes} [Wed Dec 15 13:31:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:23.113303 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da1126-bc8a-4fe5-a4a6-4eab7e6b2f4b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.113585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da1126-bc8a-4fe5-a4a6-4eab7e6b2f4b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.113880 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da1126-bc8a-4fe5-a4a6-4eab7e6b2f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.132397 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f0da1126-bc8a-4fe5-a4a6-4eab7e6b2f4b None None] MFA Rules not processed for user `80ddafedf2734326832ab4bf620f7634`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:23.133584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f0da1126-bc8a-4fe5-a4a6-4eab7e6b2f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:23.139933 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 732/1478] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Dec 15 13:31:23 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:23.147695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27768691-b332-414e-806f-74d8e3451e14 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:23.158143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27768691-b332-414e-806f-74d8e3451e14 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:23.161840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39437e1-2cbd-4df6-a81c-a17eae55c3c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ddafedf2734326832ab4bf620f7634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:23.162464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39437e1-2cbd-4df6-a81c-a17eae55c3c1 service glance] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:23.162744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39437e1-2cbd-4df6-a81c-a17eae55c3c1 service glance] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:23.163017 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39437e1-2cbd-4df6-a81c-a17eae55c3c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:23.172375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39437e1-2cbd-4df6-a81c-a17eae55c3c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:23.173847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39437e1-2cbd-4df6-a81c-a17eae55c3c1 service glance] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:23.183218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 747/1479] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:25.628396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95acc-c94f-4087-b280-a801b2444f0c None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.628918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95acc-c94f-4087-b280-a801b2444f0c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.628918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95acc-c94f-4087-b280-a801b2444f0c None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.630655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 733/1480] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:31:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:25.637512 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b297c-6cd8-40b1-b741-f18e47492bd7 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.638002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b297c-6cd8-40b1-b741-f18e47492bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.638108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b297c-6cd8-40b1-b741-f18e47492bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.655707 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-c99b297c-6cd8-40b1-b741-f18e47492bd7 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:25.656932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c99b297c-6cd8-40b1-b741-f18e47492bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:25.665034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 748/1481] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:31:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:31:25.689618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc95acc-c94f-4087-b280-a801b2444f0c None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:25.702605 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc95acc-c94f-4087-b280-a801b2444f0c None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:25.707131 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc122881-be29-4778-90f9-ad9d1c281916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:25.707768 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc122881-be29-4778-90f9-ad9d1c281916 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:25.708042 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc122881-be29-4778-90f9-ad9d1c281916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:25.708309 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc122881-be29-4778-90f9-ad9d1c281916 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:25.709044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc122881-be29-4778-90f9-ad9d1c281916 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:25.710918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc122881-be29-4778-90f9-ad9d1c281916 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:25.730298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 734/1482] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Dec 15 13:31:25 2021] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:31:28.101073 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2c125-6b49-4f50-b390-9fc9046146cb None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.101583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2c125-6b49-4f50-b390-9fc9046146cb None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.101583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2c125-6b49-4f50-b390-9fc9046146cb None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.103997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 749/1483] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:31:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:28.109849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077dee0-a02a-43d3-97e1-42fc3340826d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.110279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077dee0-a02a-43d3-97e1-42fc3340826d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.110408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077dee0-a02a-43d3-97e1-42fc3340826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.128783 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c077dee0-a02a-43d3-97e1-42fc3340826d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:28.130026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c077dee0-a02a-43d3-97e1-42fc3340826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:28.138680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 735/1484] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:31:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:28.183575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2c125-6b49-4f50-b390-9fc9046146cb None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:28.198527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2c125-6b49-4f50-b390-9fc9046146cb None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:28.204079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24ec4d-f32a-4ef7-bc83-e20910f9d46e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:28.204733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24ec4d-f32a-4ef7-bc83-e20910f9d46e service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:28.205011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24ec4d-f32a-4ef7-bc83-e20910f9d46e service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:28.205281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24ec4d-f32a-4ef7-bc83-e20910f9d46e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:28.214589 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24ec4d-f32a-4ef7-bc83-e20910f9d46e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:28.216174 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24ec4d-f32a-4ef7-bc83-e20910f9d46e service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:28.226052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 750/1485] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:30.786821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fc836-1477-4024-842b-e00567344e3e None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.787386 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fc836-1477-4024-842b-e00567344e3e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.787386 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fc836-1477-4024-842b-e00567344e3e None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.789182 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 736/1486] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:31:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:30.795211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716f4c7-de08-40fb-b880-d2c63807460c None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.795634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716f4c7-de08-40fb-b880-d2c63807460c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.795802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716f4c7-de08-40fb-b880-d2c63807460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.814153 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-6716f4c7-de08-40fb-b880-d2c63807460c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:30.815353 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6716f4c7-de08-40fb-b880-d2c63807460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:30.824011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 751/1487] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:31:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:30.861265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fc836-1477-4024-842b-e00567344e3e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:30.872405 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fc836-1477-4024-842b-e00567344e3e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:30.875901 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a968d-9318-4ab4-a576-189b8c03ea6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:30.876540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a968d-9318-4ab4-a576-189b8c03ea6c service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:30.876818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a968d-9318-4ab4-a576-189b8c03ea6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:30.877092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a968d-9318-4ab4-a576-189b8c03ea6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:30.886654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a968d-9318-4ab4-a576-189b8c03ea6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:30.888072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a968d-9318-4ab4-a576-189b8c03ea6c service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:30.897518 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 737/1488] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:33.301999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad86a-c43a-4a23-b151-fd3f04c886ec None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:33.302566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad86a-c43a-4a23-b151-fd3f04c886ec None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:33.302566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad86a-c43a-4a23-b151-fd3f04c886ec None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:33.304342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 752/1489] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:31:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:33.310693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022439f5-732a-40c9-93fe-59ca2d00520b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:33.311133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022439f5-732a-40c9-93fe-59ca2d00520b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:33.311261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022439f5-732a-40c9-93fe-59ca2d00520b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:33.329620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-022439f5-732a-40c9-93fe-59ca2d00520b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:33.330835 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-022439f5-732a-40c9-93fe-59ca2d00520b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:33.338470 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 738/1490] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:31:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:33.378895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ad86a-c43a-4a23-b151-fd3f04c886ec None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:33.389297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ad86a-c43a-4a23-b151-fd3f04c886ec None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:33.392892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918eaf3f-99f9-4eea-98f8-6b21bcb765cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:33.393508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918eaf3f-99f9-4eea-98f8-6b21bcb765cc service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:33.393809 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918eaf3f-99f9-4eea-98f8-6b21bcb765cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:33.394082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918eaf3f-99f9-4eea-98f8-6b21bcb765cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:33.402615 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918eaf3f-99f9-4eea-98f8-6b21bcb765cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:33.404026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918eaf3f-99f9-4eea-98f8-6b21bcb765cc service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:33.413058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 753/1491] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:31:35.884574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371667-13a7-4660-925d-b47761554585 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:35.885202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371667-13a7-4660-925d-b47761554585 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:35.885202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371667-13a7-4660-925d-b47761554585 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:35.886910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 739/1492] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:31:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:35.892693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3da8e-2c1d-4420-82a3-ee973b84976e None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:35.893173 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3da8e-2c1d-4420-82a3-ee973b84976e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:35.893288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3da8e-2c1d-4420-82a3-ee973b84976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:35.911076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-87a3da8e-2c1d-4420-82a3-ee973b84976e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:35.912200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-87a3da8e-2c1d-4420-82a3-ee973b84976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:35.920607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 754/1493] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:31:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:35.964354 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6371667-13a7-4660-925d-b47761554585 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:35.975124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6371667-13a7-4660-925d-b47761554585 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:35.979135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac61767-78d8-44f2-8459-01aa77e1883b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:35.979783 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac61767-78d8-44f2-8459-01aa77e1883b service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:35.980058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac61767-78d8-44f2-8459-01aa77e1883b service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:35.980327 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac61767-78d8-44f2-8459-01aa77e1883b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:35.989797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac61767-78d8-44f2-8459-01aa77e1883b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:35.991215 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac61767-78d8-44f2-8459-01aa77e1883b service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:36.001530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 740/1494] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:31:38.644902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d19a60-c4de-4ea5-b54f-e3693cff7a33 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:38.645458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d19a60-c4de-4ea5-b54f-e3693cff7a33 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:38.645458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d19a60-c4de-4ea5-b54f-e3693cff7a33 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:38.647228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 755/1495] 10.222.0.83 () {54 vars in 926 bytes} [Wed Dec 15 13:31:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:31:38.653552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2ea3-f645-415f-8f94-0348c1b24a3e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:38.653985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2ea3-f645-415f-8f94-0348c1b24a3e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:38.654141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2ea3-f645-415f-8f94-0348c1b24a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:38.671655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-fa9a2ea3-f645-415f-8f94-0348c1b24a3e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:31:38.672830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fa9a2ea3-f645-415f-8f94-0348c1b24a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:31:38.680348 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 741/1496] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Dec 15 13:31:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:31:38.720992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d19a60-c4de-4ea5-b54f-e3693cff7a33 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:31:38.731527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d19a60-c4de-4ea5-b54f-e3693cff7a33 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:31:38.735227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc2e11-275b-4a7e-92c8-b01394ed0e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:31:38.735865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc2e11-275b-4a7e-92c8-b01394ed0e73 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:31:38.736143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc2e11-275b-4a7e-92c8-b01394ed0e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:31:38.736414 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc2e11-275b-4a7e-92c8-b01394ed0e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:31:38.745269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc2e11-275b-4a7e-92c8-b01394ed0e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:31:38.746735 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc2e11-275b-4a7e-92c8-b01394ed0e73 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:31:38.755811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 756/1497] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:31:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:32:57.388813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c870c-1d21-4507-bc9e-f07bb82f990f None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:57.389431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c870c-1d21-4507-bc9e-f07bb82f990f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:57.389431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c870c-1d21-4507-bc9e-f07bb82f990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:57.407562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-556c870c-1d21-4507-bc9e-f07bb82f990f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:57.408784 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-556c870c-1d21-4507-bc9e-f07bb82f990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:57.416547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 742/1498] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:32:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:57.424587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8eab1-c33e-4c68-928c-079caa31624d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:57.425057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8eab1-c33e-4c68-928c-079caa31624d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:57.425163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8eab1-c33e-4c68-928c-079caa31624d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:57.442897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-daf8eab1-c33e-4c68-928c-079caa31624d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:57.444057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-daf8eab1-c33e-4c68-928c-079caa31624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:57.451883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 757/1499] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:32:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:32:57.456351 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c870c-1d21-4507-bc9e-f07bb82f990f None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:57.466448 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c870c-1d21-4507-bc9e-f07bb82f990f None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:57.470865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17939b7-9a12-4a7a-9f8e-a1bdacb6d422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:57.471511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17939b7-9a12-4a7a-9f8e-a1bdacb6d422 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:57.471789 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17939b7-9a12-4a7a-9f8e-a1bdacb6d422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:57.472062 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17939b7-9a12-4a7a-9f8e-a1bdacb6d422 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:57.472793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17939b7-9a12-4a7a-9f8e-a1bdacb6d422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:32:57.473096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17939b7-9a12-4a7a-9f8e-a1bdacb6d422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:57.474712 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17939b7-9a12-4a7a-9f8e-a1bdacb6d422 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:57.486011 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 743/1500] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:32:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:32:57.493992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8eab1-c33e-4c68-928c-079caa31624d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:57.502842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8eab1-c33e-4c68-928c-079caa31624d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:57.507787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb0cf1-b469-47fc-80e2-c43efa9dd6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:57.508423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0cf1-b469-47fc-80e2-c43efa9dd6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:57.508701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0cf1-b469-47fc-80e2-c43efa9dd6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:57.508977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0cf1-b469-47fc-80e2-c43efa9dd6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:57.509670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb0cf1-b469-47fc-80e2-c43efa9dd6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:57.511786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb0cf1-b469-47fc-80e2-c43efa9dd6b6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:57.547297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 758/1501] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:32:57 2021] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:57.551440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17939b7-9a12-4a7a-9f8e-a1bdacb6d422 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:57.561110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17939b7-9a12-4a7a-9f8e-a1bdacb6d422 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:57.614172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03be453-1b2d-4cda-9123-77fc4ab224fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:57.614830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03be453-1b2d-4cda-9123-77fc4ab224fd admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:57.615107 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03be453-1b2d-4cda-9123-77fc4ab224fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:57.615377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03be453-1b2d-4cda-9123-77fc4ab224fd admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:57.616076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03be453-1b2d-4cda-9123-77fc4ab224fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:57.618102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03be453-1b2d-4cda-9123-77fc4ab224fd admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:57.638035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 744/1502] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:32:57 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:32:57.642237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb0cf1-b469-47fc-80e2-c43efa9dd6b6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:57.652782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb0cf1-b469-47fc-80e2-c43efa9dd6b6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:57.657313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d15da4-b17f-4d5b-8606-aed8464b5f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:57.657993 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d15da4-b17f-4d5b-8606-aed8464b5f53 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:57.658289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d15da4-b17f-4d5b-8606-aed8464b5f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:57.658560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d15da4-b17f-4d5b-8606-aed8464b5f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:57.659289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d15da4-b17f-4d5b-8606-aed8464b5f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:57.660865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d15da4-b17f-4d5b-8606-aed8464b5f53 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:57.673361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 759/1503] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:57.677328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03be453-1b2d-4cda-9123-77fc4ab224fd admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:57.687256 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03be453-1b2d-4cda-9123-77fc4ab224fd admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:57.692461 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69fbdb-8e19-4f5a-b889-904a8cfd3e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:57.693172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fbdb-8e19-4f5a-b889-904a8cfd3e28 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:57.693449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fbdb-8e19-4f5a-b889-904a8cfd3e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:57.693726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fbdb-8e19-4f5a-b889-904a8cfd3e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:57.694496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69fbdb-8e19-4f5a-b889-904a8cfd3e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:57.696377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69fbdb-8e19-4f5a-b889-904a8cfd3e28 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:57.709954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 745/1504] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:32:57.714132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d15da4-b17f-4d5b-8606-aed8464b5f53 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:57.723709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d15da4-b17f-4d5b-8606-aed8464b5f53 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:57.728171 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ed072-e9f5-429a-9767-f6619b4e8a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:57.729034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ed072-e9f5-429a-9767-f6619b4e8a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:57.729314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ed072-e9f5-429a-9767-f6619b4e8a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:57.729590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ed072-e9f5-429a-9767-f6619b4e8a6d admin admin] PATH_INFO: `/v3/projects/e2912e81078b48779400cb0724fccfea/users/d6528163bf854f598a529d6584b4174b/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:57.744753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ed072-e9f5-429a-9767-f6619b4e8a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2912e81078b48779400cb0724fccfea, user_id=d6528163bf854f598a529d6584b4174b, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:57.747419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ed072-e9f5-429a-9767-f6619b4e8a6d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:57.761287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 760/1505] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:32:57 2021] PUT /identity/v3/projects/e2912e81078b48779400cb0724fccfea/users/d6528163bf854f598a529d6584b4174b/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:32:57.772438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2807-2ddc-49b8-a19f-50a3424fd29a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:57.772752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2807-2ddc-49b8-a19f-50a3424fd29a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:57.773030 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2807-2ddc-49b8-a19f-50a3424fd29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:57.798068 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-041e2807-2ddc-49b8-a19f-50a3424fd29a None None] MFA Rules not processed for user `d6528163bf854f598a529d6584b4174b`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:57.799261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-041e2807-2ddc-49b8-a19f-50a3424fd29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:57.860179 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 746/1506] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:32:57 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:32:57.872898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ed072-e9f5-429a-9767-f6619b4e8a6d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:57.940558 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ed072-e9f5-429a-9767-f6619b4e8a6d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:57.951897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a5fe8-4c4f-4fed-b6c2-f702212789ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:57.952548 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5fe8-4c4f-4fed-b6c2-f702212789ed service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:57.952830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5fe8-4c4f-4fed-b6c2-f702212789ed service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:57.953112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5fe8-4c4f-4fed-b6c2-f702212789ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:57.961108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a5fe8-4c4f-4fed-b6c2-f702212789ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:57.962717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a5fe8-4c4f-4fed-b6c2-f702212789ed service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:57.971332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 761/1507] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:57 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:58.038473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198710c-fc88-4553-9ce0-15dbe6bcd7ab None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:58.038762 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198710c-fc88-4553-9ce0-15dbe6bcd7ab None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:58.039039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198710c-fc88-4553-9ce0-15dbe6bcd7ab None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:58.040720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 747/1508] 10.222.0.83 () {52 vars in 829 bytes} [Wed Dec 15 13:32:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:32:58.044302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a5fe8-4c4f-4fed-b6c2-f702212789ed service nova] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:58.103768 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a5fe8-4c4f-4fed-b6c2-f702212789ed service nova] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:58.108232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:58.109080 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:58.109356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:58.109630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] PATH_INFO: `/v3/users/d6528163bf854f598a529d6584b4174b` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:58.110836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6528163bf854f598a529d6584b4174b)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:58.112211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:32:58.112211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:32:58.112211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:32:58.113977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:58.177059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6528163bf854f598a529d6584b4174b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:58.188807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6528163bf854f598a529d6584b4174b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:58.189451 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6528163bf854f598a529d6584b4174b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:58.209731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6528163bf854f598a529d6584b4174b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:58.210477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6528163bf854f598a529d6584b4174b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:58.225170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 762/1509] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:32:58 2021] DELETE /identity/v3/users/d6528163bf854f598a529d6584b4174b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:32:58.229593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5aa0c-7a1f-4e6b-b798-dcb8cade4706 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:58.229913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5aa0c-7a1f-4e6b-b798-dcb8cade4706 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:58.230238 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5aa0c-7a1f-4e6b-b798-dcb8cade4706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:58.248877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-eeb5aa0c-7a1f-4e6b-b798-dcb8cade4706 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:32:58.250098 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-eeb5aa0c-7a1f-4e6b-b798-dcb8cade4706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:58.307448 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 748/1510] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:32:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:32:58.317162 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:58.318609 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:58.373878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d91c12-a842-42f8-807a-d3c98865bf2a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:58.377379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dda59-c6d4-4249-8a54-ca864674e028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:58.378041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dda59-c6d4-4249-8a54-ca864674e028 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:58.378323 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dda59-c6d4-4249-8a54-ca864674e028 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:58.378612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dda59-c6d4-4249-8a54-ca864674e028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:58.387286 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dda59-c6d4-4249-8a54-ca864674e028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:58.388701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dda59-c6d4-4249-8a54-ca864674e028 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:58.397826 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 763/1511] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:32:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:32:58.721891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5aa0c-7a1f-4e6b-b798-dcb8cade4706 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:32:58.724102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-eeb5aa0c-7a1f-4e6b-b798-dcb8cade4706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:32:58.735565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5aa0c-7a1f-4e6b-b798-dcb8cade4706 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:32:58.741349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:32:58.742259 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:32:58.742533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:32:58.742799 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] PATH_INFO: `/v3/projects/e2912e81078b48779400cb0724fccfea` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:32:58.744424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2912e81078b48779400cb0724fccfea)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:32:58.752930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:32:58.752930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:32:58.752930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:32:58.754428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:32:58.813731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2912e81078b48779400cb0724fccfea', 'request_id': 'req-f3858b15-8f46-439f-8f1d-577a66568f8a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:58.826822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2912e81078b48779400cb0724fccfea', 'request_id': 'req-f3858b15-8f46-439f-8f1d-577a66568f8a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:58.836247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2912e81078b48779400cb0724fccfea', 'request_id': 'req-f3858b15-8f46-439f-8f1d-577a66568f8a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:58.846786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] The token cache is being invalidate because project e2912e81078b48779400cb0724fccfea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:32:58.847089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:58.848401 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f3858b15-8f46-439f-8f1d-577a66568f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:32:58.849961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 749/1512] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:32:58 2021] DELETE /identity/v3/projects/e2912e81078b48779400cb0724fccfea => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:34:29.246437 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c757b0-75fa-4d3c-9e53-9bb95426f6b4 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:29.247144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c757b0-75fa-4d3c-9e53-9bb95426f6b4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:29.247447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c757b0-75fa-4d3c-9e53-9bb95426f6b4 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:29.249541 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 764/1513] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:34:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:34:29.259039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a929a-c6cb-4de8-aec1-2d4a957d1755 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:29.259593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a929a-c6cb-4de8-aec1-2d4a957d1755 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:29.260022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a929a-c6cb-4de8-aec1-2d4a957d1755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:29.280135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e54a929a-c6cb-4de8-aec1-2d4a957d1755 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:29.281358 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e54a929a-c6cb-4de8-aec1-2d4a957d1755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:29.341978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 750/1514] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:34:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:29.500157 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c757b0-75fa-4d3c-9e53-9bb95426f6b4 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:29.501878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-29c757b0-75fa-4d3c-9e53-9bb95426f6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:29.584357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c757b0-75fa-4d3c-9e53-9bb95426f6b4 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:29.592523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c14a73-9c83-4adf-a5a1-e38ccbee9b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:29.593638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14a73-9c83-4adf-a5a1-e38ccbee9b00 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:29.594138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14a73-9c83-4adf-a5a1-e38ccbee9b00 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:29.594430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14a73-9c83-4adf-a5a1-e38ccbee9b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:29.604255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c14a73-9c83-4adf-a5a1-e38ccbee9b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:29.605896 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c14a73-9c83-4adf-a5a1-e38ccbee9b00 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:29.617298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 765/1515] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:30.012207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1888-6123-409c-b22c-d40e99518941 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:30.012561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1888-6123-409c-b22c-d40e99518941 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:30.012810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1888-6123-409c-b22c-d40e99518941 None None] PATH_INFO: `/v3` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:30.014151 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 751/1516] 10.222.0.66 () {54 vars in 925 bytes} [Wed Dec 15 13:34:30 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:34:30.021633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28752729-576f-4f6b-b332-29b93e23ddb5 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:30.022154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28752729-576f-4f6b-b332-29b93e23ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:30.022459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28752729-576f-4f6b-b332-29b93e23ddb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:30.041465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-28752729-576f-4f6b-b332-29b93e23ddb5 None None] MFA Rules not processed for user `797b1d42ac3a427bb084740a069b577d`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:30.042688 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-28752729-576f-4f6b-b332-29b93e23ddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:30.108221 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 766/1517] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Dec 15 13:34:30 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:31.178418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab358b7-947e-4431-be2a-49449619a2e0 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:31.179086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab358b7-947e-4431-be2a-49449619a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:31.179086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab358b7-947e-4431-be2a-49449619a2e0 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:31.180751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 752/1518] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:34:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:34:31.186297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa945b6-eb47-418f-b5dd-876d72795869 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:31.186790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa945b6-eb47-418f-b5dd-876d72795869 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:31.186920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa945b6-eb47-418f-b5dd-876d72795869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:31.208053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-0fa945b6-eb47-418f-b5dd-876d72795869 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:31.209342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0fa945b6-eb47-418f-b5dd-876d72795869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:31.218141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 767/1519] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:34:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:31.381278 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab358b7-947e-4431-be2a-49449619a2e0 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:31.396079 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab358b7-947e-4431-be2a-49449619a2e0 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:31.401582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7977e6-7491-466f-b2bb-28ca49357e28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:31.402377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7977e6-7491-466f-b2bb-28ca49357e28 service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:31.402682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7977e6-7491-466f-b2bb-28ca49357e28 service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:31.402977 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7977e6-7491-466f-b2bb-28ca49357e28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:31.413358 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7977e6-7491-466f-b2bb-28ca49357e28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:31.415175 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7977e6-7491-466f-b2bb-28ca49357e28 service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:31.426005 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 753/1520] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:33.857874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f2791-22a4-493f-bbd6-661b336a04f7 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:33.858336 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f2791-22a4-493f-bbd6-661b336a04f7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:33.858437 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f2791-22a4-493f-bbd6-661b336a04f7 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:33.860163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 768/1521] 10.222.0.83 () {54 vars in 960 bytes} [Wed Dec 15 13:34:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:34:33.866034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d4eb-b6cf-4054-a6b1-473565cb3731 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:33.866477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d4eb-b6cf-4054-a6b1-473565cb3731 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:33.866589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d4eb-b6cf-4054-a6b1-473565cb3731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:33.885657 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b4d0d4eb-b6cf-4054-a6b1-473565cb3731 None None] MFA Rules not processed for user `797b1d42ac3a427bb084740a069b577d`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:33.886888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b4d0d4eb-b6cf-4054-a6b1-473565cb3731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:33.895334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 754/1522] 10.222.0.83 () {58 vars in 1057 bytes} [Wed Dec 15 13:34:33 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:33.903259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f2791-22a4-493f-bbd6-661b336a04f7 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:33.917020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f2791-22a4-493f-bbd6-661b336a04f7 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:33.922674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460f33a-2701-4534-9475-116563157800 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b1d42ac3a427bb084740a069b577d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:33.923447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460f33a-2701-4534-9475-116563157800 service placement] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:33.923729 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460f33a-2701-4534-9475-116563157800 service placement] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:33.924498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460f33a-2701-4534-9475-116563157800 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:33.933426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460f33a-2701-4534-9475-116563157800 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:33.935042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460f33a-2701-4534-9475-116563157800 service placement] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:33.945770 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 769/1523] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:33 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:43.358617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6f9dc-b867-401c-aef4-96d796ef296e None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:43.359273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6f9dc-b867-401c-aef4-96d796ef296e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:43.359273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6f9dc-b867-401c-aef4-96d796ef296e None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:43.360967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 755/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:34:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:34:43.366580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d9a49-5386-4c58-8a92-2f8ad2b1fabe None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:43.367032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d9a49-5386-4c58-8a92-2f8ad2b1fabe None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:43.367138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d9a49-5386-4c58-8a92-2f8ad2b1fabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:43.386048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-551d9a49-5386-4c58-8a92-2f8ad2b1fabe None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:43.387246 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-551d9a49-5386-4c58-8a92-2f8ad2b1fabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:43.395962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 770/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:34:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:43.553049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6f9dc-b867-401c-aef4-96d796ef296e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:43.567756 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6f9dc-b867-401c-aef4-96d796ef296e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:43.573966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f3df9-9261-4ffd-86f8-c89a9a7843a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:43.574609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3df9-9261-4ffd-86f8-c89a9a7843a7 service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:43.574889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3df9-9261-4ffd-86f8-c89a9a7843a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:43.575295 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3df9-9261-4ffd-86f8-c89a9a7843a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:43.584201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f3df9-9261-4ffd-86f8-c89a9a7843a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:43.586024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f3df9-9261-4ffd-86f8-c89a9a7843a7 service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:43.596127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 756/1526] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:34:45.115845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32efd2-2c0c-4366-b727-4c88585e35fc None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.116379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32efd2-2c0c-4366-b727-4c88585e35fc None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.116379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32efd2-2c0c-4366-b727-4c88585e35fc None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.118238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 771/1527] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:34:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:34:45.123389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fc969-8d5d-4d3a-8671-e0b9b3423f65 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.123802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fc969-8d5d-4d3a-8671-e0b9b3423f65 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.123945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fc969-8d5d-4d3a-8671-e0b9b3423f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.141384 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d58fc969-8d5d-4d3a-8671-e0b9b3423f65 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:45.142635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d58fc969-8d5d-4d3a-8671-e0b9b3423f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:45.150724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 757/1528] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:34:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:45.304617 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32efd2-2c0c-4366-b727-4c88585e35fc None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:45.319293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32efd2-2c0c-4366-b727-4c88585e35fc None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:45.324802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ced65-eb61-4a79-88aa-02c1adeb6088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:45.325423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ced65-eb61-4a79-88aa-02c1adeb6088 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:45.325701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ced65-eb61-4a79-88aa-02c1adeb6088 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:45.326010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ced65-eb61-4a79-88aa-02c1adeb6088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:45.333774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ced65-eb61-4a79-88aa-02c1adeb6088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:45.335354 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ced65-eb61-4a79-88aa-02c1adeb6088 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:45.344275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 772/1529] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:50.234883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb0c67-4d66-4e63-a782-b8c48f1074c3 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:50.235453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb0c67-4d66-4e63-a782-b8c48f1074c3 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:50.235453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb0c67-4d66-4e63-a782-b8c48f1074c3 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:50.237687 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 758/1530] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:34:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:34:50.243446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491e0f1-2092-4a1b-a42c-e75c472667df None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:50.243847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491e0f1-2092-4a1b-a42c-e75c472667df None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:50.244004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491e0f1-2092-4a1b-a42c-e75c472667df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:50.262223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5491e0f1-2092-4a1b-a42c-e75c472667df None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:50.263408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5491e0f1-2092-4a1b-a42c-e75c472667df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:50.271235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 773/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:34:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:50.310692 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb0c67-4d66-4e63-a782-b8c48f1074c3 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:50.312373 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0fcb0c67-4d66-4e63-a782-b8c48f1074c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:50.369599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb0c67-4d66-4e63-a782-b8c48f1074c3 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:50.373124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd1b51-50ce-41eb-9e06-d40dc4bfdfea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:50.373779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1b51-50ce-41eb-9e06-d40dc4bfdfea service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:50.374071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1b51-50ce-41eb-9e06-d40dc4bfdfea service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:50.374346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1b51-50ce-41eb-9e06-d40dc4bfdfea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:50.383624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd1b51-50ce-41eb-9e06-d40dc4bfdfea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:50.385044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd1b51-50ce-41eb-9e06-d40dc4bfdfea service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:50.394092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 759/1532] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:52.757458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf85aa-d8c3-4dca-8c4f-2872bc00526b None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.758067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf85aa-d8c3-4dca-8c4f-2872bc00526b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.758067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf85aa-d8c3-4dca-8c4f-2872bc00526b None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.759796 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 774/1533] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:34:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:34:52.765871 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0fe94-f6ac-4a83-93fe-8145711a3654 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.766293 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0fe94-f6ac-4a83-93fe-8145711a3654 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.766465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0fe94-f6ac-4a83-93fe-8145711a3654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.785478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-a4a0fe94-f6ac-4a83-93fe-8145711a3654 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:52.786722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a4a0fe94-f6ac-4a83-93fe-8145711a3654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:52.794532 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 760/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:34:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:52.833677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf85aa-d8c3-4dca-8c4f-2872bc00526b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:52.835441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-14bf85aa-d8c3-4dca-8c4f-2872bc00526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:52.848533 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf85aa-d8c3-4dca-8c4f-2872bc00526b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:52.851958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7517f00-5bb8-47e1-9f3b-1a55266164bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:52.852590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7517f00-5bb8-47e1-9f3b-1a55266164bb service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:52.852869 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7517f00-5bb8-47e1-9f3b-1a55266164bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:52.853150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7517f00-5bb8-47e1-9f3b-1a55266164bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:52.862474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7517f00-5bb8-47e1-9f3b-1a55266164bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:52.863893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7517f00-5bb8-47e1-9f3b-1a55266164bb service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:52.873787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 775/1535] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:56.984401 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01122f7c-096c-4ff5-abf5-b3e772ac0411 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:56.984925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01122f7c-096c-4ff5-abf5-b3e772ac0411 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:56.984925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01122f7c-096c-4ff5-abf5-b3e772ac0411 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:56.986709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 761/1536] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:34:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:34:56.992813 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae137ed-d39b-48b6-921a-e52c8b806c83 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:56.993318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae137ed-d39b-48b6-921a-e52c8b806c83 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:56.993410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae137ed-d39b-48b6-921a-e52c8b806c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:57.011740 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-0ae137ed-d39b-48b6-921a-e52c8b806c83 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:57.012940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0ae137ed-d39b-48b6-921a-e52c8b806c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:57.023659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 776/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:34:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:57.075870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01122f7c-096c-4ff5-abf5-b3e772ac0411 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:57.077545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-01122f7c-096c-4ff5-abf5-b3e772ac0411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:57.137396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01122f7c-096c-4ff5-abf5-b3e772ac0411 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:57.140934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f145e-cd5e-4358-9588-aaa4c0dd517c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:57.141585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f145e-cd5e-4358-9588-aaa4c0dd517c service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:57.141902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f145e-cd5e-4358-9588-aaa4c0dd517c service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:57.142176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f145e-cd5e-4358-9588-aaa4c0dd517c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:57.152018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f145e-cd5e-4358-9588-aaa4c0dd517c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:57.153518 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f145e-cd5e-4358-9588-aaa4c0dd517c service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:57.164384 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 762/1538] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:34:59.518145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b8292-1e69-4867-ba85-55634b4c2142 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.518728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b8292-1e69-4867-ba85-55634b4c2142 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.518728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b8292-1e69-4867-ba85-55634b4c2142 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.520962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 777/1539] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:34:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:34:59.528041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dba7b-5284-41a4-9dab-a72ab2732d3f None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.528584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dba7b-5284-41a4-9dab-a72ab2732d3f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.528584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dba7b-5284-41a4-9dab-a72ab2732d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.549662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-0e4dba7b-5284-41a4-9dab-a72ab2732d3f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:59.550219 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0e4dba7b-5284-41a4-9dab-a72ab2732d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:59.558247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 763/1540] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:34:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:59.609592 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87074c-18b2-44a6-a5c6-11fb1a4737d7 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.609950 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87074c-18b2-44a6-a5c6-11fb1a4737d7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.610232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87074c-18b2-44a6-a5c6-11fb1a4737d7 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.611977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 778/1541] 10.222.0.83 () {54 vars in 963 bytes} [Wed Dec 15 13:34:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:34:59.617298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334c10-2470-437f-b354-86b4e0d91723 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.617607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334c10-2470-437f-b354-86b4e0d91723 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.617913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334c10-2470-437f-b354-86b4e0d91723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.636817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-4a334c10-2470-437f-b354-86b4e0d91723 None None] MFA Rules not processed for user `63a5db2990424915ac1daf36d14a733b`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:34:59.638046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4a334c10-2470-437f-b354-86b4e0d91723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:34:59.645745 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 764/1542] 10.222.0.83 () {58 vars in 1060 bytes} [Wed Dec 15 13:34:59 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:34:59.654195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87074c-18b2-44a6-a5c6-11fb1a4737d7 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:34:59.664815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87074c-18b2-44a6-a5c6-11fb1a4737d7 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:34:59.668828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314890fb-a698-4d22-9e84-a3f2ab780de4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:34:59.669462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314890fb-a698-4d22-9e84-a3f2ab780de4 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:34:59.669744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314890fb-a698-4d22-9e84-a3f2ab780de4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:34:59.670032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314890fb-a698-4d22-9e84-a3f2ab780de4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:34:59.679101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314890fb-a698-4d22-9e84-a3f2ab780de4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:34:59.680515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314890fb-a698-4d22-9e84-a3f2ab780de4 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:34:59.689885 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 779/1543] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:34:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:20.675878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecf22b-5d39-4d94-bb2f-40b5d673d633 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:20.675878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecf22b-5d39-4d94-bb2f-40b5d673d633 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:20.675878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecf22b-5d39-4d94-bb2f-40b5d673d633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:20.689460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d4ecf22b-5d39-4d94-bb2f-40b5d673d633 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:20.690826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d4ecf22b-5d39-4d94-bb2f-40b5d673d633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:20.703589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 765/1544] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:20.714297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc123e11-5f36-45de-bc18-d43100c1baed None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:20.714852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc123e11-5f36-45de-bc18-d43100c1baed None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:20.714852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc123e11-5f36-45de-bc18-d43100c1baed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:20.744680 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-cc123e11-5f36-45de-bc18-d43100c1baed None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:20.745911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-cc123e11-5f36-45de-bc18-d43100c1baed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:20.758935 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 780/1545] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:20.764027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecf22b-5d39-4d94-bb2f-40b5d673d633 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:20.779883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecf22b-5d39-4d94-bb2f-40b5d673d633 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:20.794425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c3341-dc5a-444d-bc00-f41b4b1e367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:20.795443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3341-dc5a-444d-bc00-f41b4b1e367c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:20.795726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3341-dc5a-444d-bc00-f41b4b1e367c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:20.795999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3341-dc5a-444d-bc00-f41b4b1e367c admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:20.802172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c3341-dc5a-444d-bc00-f41b4b1e367c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:20.802172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c3341-dc5a-444d-bc00-f41b4b1e367c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:20.802172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c3341-dc5a-444d-bc00-f41b4b1e367c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:20.818714 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 766/1546] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:20.826824 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc123e11-5f36-45de-bc18-d43100c1baed None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:20.841728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc123e11-5f36-45de-bc18-d43100c1baed None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:20.854145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480ba86-6cf9-4c32-92be-7ef8bb7b4490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:20.854800 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ba86-6cf9-4c32-92be-7ef8bb7b4490 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:20.855078 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ba86-6cf9-4c32-92be-7ef8bb7b4490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:20.855352 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ba86-6cf9-4c32-92be-7ef8bb7b4490 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:20.856058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ba86-6cf9-4c32-92be-7ef8bb7b4490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:20.857966 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ba86-6cf9-4c32-92be-7ef8bb7b4490 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:20.907918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 781/1547] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:20 2021] POST /identity/v3/projects => generated 389 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:20.913026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c3341-dc5a-444d-bc00-f41b4b1e367c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:20.926370 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf086a-4050-4abc-8bd3-c72ab5bf58f3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:20.926682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf086a-4050-4abc-8bd3-c72ab5bf58f3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:20.929464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf086a-4050-4abc-8bd3-c72ab5bf58f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:20.929583 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c3341-dc5a-444d-bc00-f41b4b1e367c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:20.949603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-eedf086a-4050-4abc-8bd3-c72ab5bf58f3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:20.950942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-eedf086a-4050-4abc-8bd3-c72ab5bf58f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.034408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 782/1548] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.038290 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e0039-9d5c-4989-b097-a82a40e45bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.039514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0039-9d5c-4989-b097-a82a40e45bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.041791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0039-9d5c-4989-b097-a82a40e45bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.041791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0039-9d5c-4989-b097-a82a40e45bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.041791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e0039-9d5c-4989-b097-a82a40e45bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.042758 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e0039-9d5c-4989-b097-a82a40e45bf0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.044803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffeac-770b-41cf-b2b6-7b959c7c0000 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.045052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffeac-770b-41cf-b2b6-7b959c7c0000 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.045326 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffeac-770b-41cf-b2b6-7b959c7c0000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.072169 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e26ffeac-770b-41cf-b2b6-7b959c7c0000 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.076492 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e26ffeac-770b-41cf-b2b6-7b959c7c0000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.088213 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 783/1549] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:21.089949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 767/1550] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:20 2021] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:21.095848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ffeac-770b-41cf-b2b6-7b959c7c0000 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.097299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e0039-9d5c-4989-b097-a82a40e45bf0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.107095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ffeac-770b-41cf-b2b6-7b959c7c0000 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.111558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e0039-9d5c-4989-b097-a82a40e45bf0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.118771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c827e36-7431-4794-826d-06ed27926e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.119445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cc87b-4a11-463c-ab31-6d594de89ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.119585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827e36-7431-4794-826d-06ed27926e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.119798 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827e36-7431-4794-826d-06ed27926e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.119991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827e36-7431-4794-826d-06ed27926e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.120111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cc87b-4a11-463c-ab31-6d594de89ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.120383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cc87b-4a11-463c-ab31-6d594de89ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.120664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cc87b-4a11-463c-ab31-6d594de89ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.120902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c827e36-7431-4794-826d-06ed27926e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:21.121213 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c827e36-7431-4794-826d-06ed27926e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.121393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8cc87b-4a11-463c-ab31-6d594de89ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.122987 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8cc87b-4a11-463c-ab31-6d594de89ec6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.123120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c827e36-7431-4794-826d-06ed27926e41 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.142360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 784/1551] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:21.145638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 768/1552] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:21.146650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cc87b-4a11-463c-ab31-6d594de89ec6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.155138 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c827e36-7431-4794-826d-06ed27926e41 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.161001 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cc87b-4a11-463c-ab31-6d594de89ec6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.169487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c827e36-7431-4794-826d-06ed27926e41 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.179173 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3f131-34ab-41de-ab1e-d266fc106c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.180391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3f131-34ab-41de-ab1e-d266fc106c36 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.180676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3f131-34ab-41de-ab1e-d266fc106c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.180946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3f131-34ab-41de-ab1e-d266fc106c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.181681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3f131-34ab-41de-ab1e-d266fc106c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.182182 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1582-2cde-46d2-8088-60463f601f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.185936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1582-2cde-46d2-8088-60463f601f50 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.185936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1582-2cde-46d2-8088-60463f601f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.186119 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3f131-34ab-41de-ab1e-d266fc106c36 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.186241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1582-2cde-46d2-8088-60463f601f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.186241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d1582-2cde-46d2-8088-60463f601f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.186539 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d1582-2cde-46d2-8088-60463f601f50 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.199166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 785/1553] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:21.202485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b875-6b48-4fc2-b7aa-3b574ff8d6cc None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.202777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b875-6b48-4fc2-b7aa-3b574ff8d6cc None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.203061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b875-6b48-4fc2-b7aa-3b574ff8d6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.253055 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 769/1554] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:21.253705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1582-2cde-46d2-8088-60463f601f50 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.255096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-afa5b875-6b48-4fc2-b7aa-3b574ff8d6cc None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.256731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-afa5b875-6b48-4fc2-b7aa-3b574ff8d6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.320999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 786/1555] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:21.322665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d64cf-a3e3-4dd8-a5a0-591de158aebe None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.322954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d64cf-a3e3-4dd8-a5a0-591de158aebe None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.323232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d64cf-a3e3-4dd8-a5a0-591de158aebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.341079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-ef9d64cf-a3e3-4dd8-a5a0-591de158aebe None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.342297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ef9d64cf-a3e3-4dd8-a5a0-591de158aebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.350261 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 787/1556] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.350850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d64cf-a3e3-4dd8-a5a0-591de158aebe None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.358079 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1582-2cde-46d2-8088-60463f601f50 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.363334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7409ed-d2c1-4dbf-8835-3e4b334a441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.364297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7409ed-d2c1-4dbf-8835-3e4b334a441e admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.364643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7409ed-d2c1-4dbf-8835-3e4b334a441e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.364985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7409ed-d2c1-4dbf-8835-3e4b334a441e admin admin] PATH_INFO: `/v3/projects/0bddd6292c044cdb9eb8e5bba5ebd4fc/users/825dcf92d1b64c3d8a6c3e41cec2c836/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.367307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d64cf-a3e3-4dd8-a5a0-591de158aebe None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.372118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b1a2e-a1c4-4a78-9577-8742d6b4d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.372853 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1a2e-a1c4-4a78-9577-8742d6b4d937 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.373201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1a2e-a1c4-4a78-9577-8742d6b4d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.373651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1a2e-a1c4-4a78-9577-8742d6b4d937 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.374454 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b1a2e-a1c4-4a78-9577-8742d6b4d937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.376438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b1a2e-a1c4-4a78-9577-8742d6b4d937 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.381354 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7409ed-d2c1-4dbf-8835-3e4b334a441e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bddd6292c044cdb9eb8e5bba5ebd4fc, user_id=825dcf92d1b64c3d8a6c3e41cec2c836, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.384761 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7409ed-d2c1-4dbf-8835-3e4b334a441e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.399900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 788/1557] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/users => generated 296 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:21.401298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34159f9a-a77f-41ed-907c-5e39132055de None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.401662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34159f9a-a77f-41ed-907c-5e39132055de None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.401866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 770/1558] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:21 2021] PUT /identity/v3/projects/0bddd6292c044cdb9eb8e5bba5ebd4fc/users/825dcf92d1b64c3d8a6c3e41cec2c836/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:21.402103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34159f9a-a77f-41ed-907c-5e39132055de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.403538 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171cd07-a566-4ffb-9e93-b81fbd9aa2fc None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.403885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171cd07-a566-4ffb-9e93-b81fbd9aa2fc None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.404223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171cd07-a566-4ffb-9e93-b81fbd9aa2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.425589 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-34159f9a-a77f-41ed-907c-5e39132055de None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.426115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c171cd07-a566-4ffb-9e93-b81fbd9aa2fc None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.426898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-34159f9a-a77f-41ed-907c-5e39132055de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.427414 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c171cd07-a566-4ffb-9e93-b81fbd9aa2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.484609 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 789/1559] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.485976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb544-8607-423b-8d8b-3fd4c96f42ed None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.486463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb544-8607-423b-8d8b-3fd4c96f42ed None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.486595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 771/1560] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.487752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67d903-a7f5-40ac-8b13-96f4c9ae2fcb None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.488097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67d903-a7f5-40ac-8b13-96f4c9ae2fcb None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.488459 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67d903-a7f5-40ac-8b13-96f4c9ae2fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.490036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb544-8607-423b-8d8b-3fd4c96f42ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.509164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-2e67d903-a7f5-40ac-8b13-96f4c9ae2fcb None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.510427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2e67d903-a7f5-40ac-8b13-96f4c9ae2fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.510727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-ea4fb544-8607-423b-8d8b-3fd4c96f42ed None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.511900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ea4fb544-8607-423b-8d8b-3fd4c96f42ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.518543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 772/1561] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.519809 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 790/1562] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.520900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3daebf-1963-4387-89c0-3eead648a7f6 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.521189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3daebf-1963-4387-89c0-3eead648a7f6 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.521468 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3daebf-1963-4387-89c0-3eead648a7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.521811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64a34-c95f-48d0-934f-2a422d6db6c1 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.522420 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64a34-c95f-48d0-934f-2a422d6db6c1 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.522771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64a34-c95f-48d0-934f-2a422d6db6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.539632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8a3daebf-1963-4387-89c0-3eead648a7f6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.540833 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8a3daebf-1963-4387-89c0-3eead648a7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.542601 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-a9b64a34-c95f-48d0-934f-2a422d6db6c1 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.543771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a9b64a34-c95f-48d0-934f-2a422d6db6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.548724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 791/1563] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.549421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3daebf-1963-4387-89c0-3eead648a7f6 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.551602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 773/1564] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.556937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02976e-1b22-4073-a963-abbfcbe16625 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.557302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02976e-1b22-4073-a963-abbfcbe16625 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.557583 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02976e-1b22-4073-a963-abbfcbe16625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.559747 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3daebf-1963-4387-89c0-3eead648a7f6 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.564360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e01954-47b8-4565-9051-7bc227efae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.565021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e01954-47b8-4565-9051-7bc227efae6d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.565301 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e01954-47b8-4565-9051-7bc227efae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.565573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e01954-47b8-4565-9051-7bc227efae6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.566363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e01954-47b8-4565-9051-7bc227efae6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.567960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e01954-47b8-4565-9051-7bc227efae6d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.576202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-1b02976e-1b22-4073-a963-abbfcbe16625 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.577391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1b02976e-1b22-4073-a963-abbfcbe16625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.578582 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 792/1565] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:21.579867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392920ef-e83a-46a3-9860-ce4bb22fa4a3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.580153 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392920ef-e83a-46a3-9860-ce4bb22fa4a3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.580429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392920ef-e83a-46a3-9860-ce4bb22fa4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.586133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 774/1566] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.589923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4888a-0c99-4f37-a64b-b98a07c9250f None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.589923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4888a-0c99-4f37-a64b-b98a07c9250f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.589923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4888a-0c99-4f37-a64b-b98a07c9250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.599990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-392920ef-e83a-46a3-9860-ce4bb22fa4a3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.601978 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-392920ef-e83a-46a3-9860-ce4bb22fa4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.606843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-fdb4888a-0c99-4f37-a64b-b98a07c9250f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.608032 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fdb4888a-0c99-4f37-a64b-b98a07c9250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.609871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 793/1567] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.610655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392920ef-e83a-46a3-9860-ce4bb22fa4a3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.619718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392920ef-e83a-46a3-9860-ce4bb22fa4a3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.619883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 775/1568] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.624197 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe1d6e-6706-4c01-923e-5bd789dd415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.624527 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907e77b-de0e-4feb-8edf-44bbab130ae0 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.624814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907e77b-de0e-4feb-8edf-44bbab130ae0 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.624939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe1d6e-6706-4c01-923e-5bd789dd415a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.625086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907e77b-de0e-4feb-8edf-44bbab130ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.625181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe1d6e-6706-4c01-923e-5bd789dd415a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.625366 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe1d6e-6706-4c01-923e-5bd789dd415a admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.626137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe1d6e-6706-4c01-923e-5bd789dd415a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:21.626446 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe1d6e-6706-4c01-923e-5bd789dd415a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.628031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe1d6e-6706-4c01-923e-5bd789dd415a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.639800 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 794/1569] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:21.640640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe1d6e-6706-4c01-923e-5bd789dd415a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.643437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-2907e77b-de0e-4feb-8edf-44bbab130ae0 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.644738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2907e77b-de0e-4feb-8edf-44bbab130ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.651188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe1d6e-6706-4c01-923e-5bd789dd415a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.653510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 776/1570] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.654457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907e77b-de0e-4feb-8edf-44bbab130ae0 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.656213 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef3e7a-ef67-4055-8f94-8e2aa31d71fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.656873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef3e7a-ef67-4055-8f94-8e2aa31d71fb admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.657147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef3e7a-ef67-4055-8f94-8e2aa31d71fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.657416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef3e7a-ef67-4055-8f94-8e2aa31d71fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.658187 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef3e7a-ef67-4055-8f94-8e2aa31d71fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:21.658488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef3e7a-ef67-4055-8f94-8e2aa31d71fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.660069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef3e7a-ef67-4055-8f94-8e2aa31d71fb admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.673386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 795/1571] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:21.674258 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef3e7a-ef67-4055-8f94-8e2aa31d71fb admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.684282 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef3e7a-ef67-4055-8f94-8e2aa31d71fb admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.688876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a05925-2339-4693-b67f-53e53b2ab292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.689542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a05925-2339-4693-b67f-53e53b2ab292 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.689866 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a05925-2339-4693-b67f-53e53b2ab292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.690148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a05925-2339-4693-b67f-53e53b2ab292 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.690879 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a05925-2339-4693-b67f-53e53b2ab292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.692465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a05925-2339-4693-b67f-53e53b2ab292 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.703391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 796/1572] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:21.704926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0dfdd-d5cd-4599-859d-d08f93c0d824 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.705312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0dfdd-d5cd-4599-859d-d08f93c0d824 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.705693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0dfdd-d5cd-4599-859d-d08f93c0d824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.714581 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907e77b-de0e-4feb-8edf-44bbab130ae0 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.718088 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6b835-b757-4191-9a30-569128b98301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.718740 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6b835-b757-4191-9a30-569128b98301 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.719012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6b835-b757-4191-9a30-569128b98301 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.719278 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6b835-b757-4191-9a30-569128b98301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.724146 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-b6b0dfdd-d5cd-4599-859d-d08f93c0d824 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:21.725339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b6b0dfdd-d5cd-4599-859d-d08f93c0d824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:21.728820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6b835-b757-4191-9a30-569128b98301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.730309 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6b835-b757-4191-9a30-569128b98301 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.734155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 797/1573] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:21.734750 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0dfdd-d5cd-4599-859d-d08f93c0d824 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.743774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0dfdd-d5cd-4599-859d-d08f93c0d824 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.744034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 777/1574] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:21.744976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6b835-b757-4191-9a30-569128b98301 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.748391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43903a5-bfa9-4c57-82db-ac6434cf9b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.749196 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43903a5-bfa9-4c57-82db-ac6434cf9b2e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.749481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43903a5-bfa9-4c57-82db-ac6434cf9b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.749787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43903a5-bfa9-4c57-82db-ac6434cf9b2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.750522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43903a5-bfa9-4c57-82db-ac6434cf9b2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:21.750827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43903a5-bfa9-4c57-82db-ac6434cf9b2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.752424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43903a5-bfa9-4c57-82db-ac6434cf9b2e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.755423 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6b835-b757-4191-9a30-569128b98301 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.760576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32507d64-0814-44ba-80c0-4f51d1c9f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.761323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32507d64-0814-44ba-80c0-4f51d1c9f73d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.761679 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32507d64-0814-44ba-80c0-4f51d1c9f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.762052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32507d64-0814-44ba-80c0-4f51d1c9f73d admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.762852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32507d64-0814-44ba-80c0-4f51d1c9f73d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:21.763156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32507d64-0814-44ba-80c0-4f51d1c9f73d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.764935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32507d64-0814-44ba-80c0-4f51d1c9f73d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.774298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 798/1575] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:21.774298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43903a5-bfa9-4c57-82db-ac6434cf9b2e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.778972 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 778/1576] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:21.780344 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32507d64-0814-44ba-80c0-4f51d1c9f73d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.780942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43903a5-bfa9-4c57-82db-ac6434cf9b2e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.791316 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ed69c-721f-490a-8e9c-d5b8f4429642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.792498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ed69c-721f-490a-8e9c-d5b8f4429642 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.792498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ed69c-721f-490a-8e9c-d5b8f4429642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.792808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ed69c-721f-490a-8e9c-d5b8f4429642 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.793686 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ed69c-721f-490a-8e9c-d5b8f4429642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.795844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ed69c-721f-490a-8e9c-d5b8f4429642 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.797011 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32507d64-0814-44ba-80c0-4f51d1c9f73d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.802423 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3c5bf-2c61-43bc-bb64-dbfcb80e4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.803096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3c5bf-2c61-43bc-bb64-dbfcb80e4f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.803360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3c5bf-2c61-43bc-bb64-dbfcb80e4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.803630 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3c5bf-2c61-43bc-bb64-dbfcb80e4f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.804396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3c5bf-2c61-43bc-bb64-dbfcb80e4f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:21.804693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3c5bf-2c61-43bc-bb64-dbfcb80e4f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.806312 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3c5bf-2c61-43bc-bb64-dbfcb80e4f00 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.819084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 779/1577] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:21.820194 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3c5bf-2c61-43bc-bb64-dbfcb80e4f00 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.828580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 799/1578] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/projects => generated 403 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:21.829483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ed69c-721f-490a-8e9c-d5b8f4429642 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.837045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3c5bf-2c61-43bc-bb64-dbfcb80e4f00 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.898913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ed69c-721f-490a-8e9c-d5b8f4429642 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:21.901257 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16fd73-405f-4e22-a6c6-746f51c179f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.902038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16fd73-405f-4e22-a6c6-746f51c179f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.902663 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16fd73-405f-4e22-a6c6-746f51c179f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.903077 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16fd73-405f-4e22-a6c6-746f51c179f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.903863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16fd73-405f-4e22-a6c6-746f51c179f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.904849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d705a7-23ba-4d83-8c3a-a5037ed42d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:21.905951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d705a7-23ba-4d83-8c3a-a5037ed42d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:21.906093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16fd73-405f-4e22-a6c6-746f51c179f1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.906431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d705a7-23ba-4d83-8c3a-a5037ed42d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:21.906840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d705a7-23ba-4d83-8c3a-a5037ed42d68 admin admin] PATH_INFO: `/v3/projects/91da5641066242d99b74a660383a26da/users/0a11e7a0c33b4df38bdb713cffe43911/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:21.925672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d705a7-23ba-4d83-8c3a-a5037ed42d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91da5641066242d99b74a660383a26da, user_id=0a11e7a0c33b4df38bdb713cffe43911, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:21.928670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d705a7-23ba-4d83-8c3a-a5037ed42d68 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:21.935082 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 780/1579] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:21.935899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16fd73-405f-4e22-a6c6-746f51c179f1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:21.951223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 800/1580] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:21 2021] PUT /identity/v3/projects/91da5641066242d99b74a660383a26da/users/0a11e7a0c33b4df38bdb713cffe43911/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:21.951223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d705a7-23ba-4d83-8c3a-a5037ed42d68 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.013181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16fd73-405f-4e22-a6c6-746f51c179f1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.023039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d705a7-23ba-4d83-8c3a-a5037ed42d68 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.028684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb681c-7064-4c02-a439-a03f4e7785f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.029596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb681c-7064-4c02-a439-a03f4e7785f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.030092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb681c-7064-4c02-a439-a03f4e7785f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.030473 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb681c-7064-4c02-a439-a03f4e7785f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.031380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb681c-7064-4c02-a439-a03f4e7785f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.033415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb681c-7064-4c02-a439-a03f4e7785f1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.061370 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 801/1581] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:21 2021] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:22.062269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb681c-7064-4c02-a439-a03f4e7785f1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.073333 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107411e9-ef40-4cdd-8a31-9126e035fc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.074188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107411e9-ef40-4cdd-8a31-9126e035fc42 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.074986 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107411e9-ef40-4cdd-8a31-9126e035fc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.075268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107411e9-ef40-4cdd-8a31-9126e035fc42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.076018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107411e9-ef40-4cdd-8a31-9126e035fc42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:22.076328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107411e9-ef40-4cdd-8a31-9126e035fc42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.077964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107411e9-ef40-4cdd-8a31-9126e035fc42 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.090380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 781/1582] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:22.091206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107411e9-ef40-4cdd-8a31-9126e035fc42 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.120537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107411e9-ef40-4cdd-8a31-9126e035fc42 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.147314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb681c-7064-4c02-a439-a03f4e7785f1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.153635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e341d-c41e-4f44-8aef-9d6ed5338824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.154410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e341d-c41e-4f44-8aef-9d6ed5338824 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.154696 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e341d-c41e-4f44-8aef-9d6ed5338824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.154985 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e341d-c41e-4f44-8aef-9d6ed5338824 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.155704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e341d-c41e-4f44-8aef-9d6ed5338824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.157732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e341d-c41e-4f44-8aef-9d6ed5338824 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.189550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 802/1583] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:22 2021] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:22.190491 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e341d-c41e-4f44-8aef-9d6ed5338824 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.200746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bb7b6-2140-4cfc-99ab-c329f9f84e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.201804 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bb7b6-2140-4cfc-99ab-c329f9f84e51 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.202155 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bb7b6-2140-4cfc-99ab-c329f9f84e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.202651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bb7b6-2140-4cfc-99ab-c329f9f84e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.203651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bb7b6-2140-4cfc-99ab-c329f9f84e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.206279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bb7b6-2140-4cfc-99ab-c329f9f84e51 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.239666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 782/1584] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:22 2021] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:22.239666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bb7b6-2140-4cfc-99ab-c329f9f84e51 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.269948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e341d-c41e-4f44-8aef-9d6ed5338824 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.302579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bb7b6-2140-4cfc-99ab-c329f9f84e51 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.308004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4c97c-8f97-4d37-a1d8-a060c51715ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.308806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4c97c-8f97-4d37-a1d8-a060c51715ee admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.309154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4c97c-8f97-4d37-a1d8-a060c51715ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.309500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4c97c-8f97-4d37-a1d8-a060c51715ee admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.310304 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4c97c-8f97-4d37-a1d8-a060c51715ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.312315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4c97c-8f97-4d37-a1d8-a060c51715ee admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.338220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 783/1585] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:22 2021] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:22.338220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfbdbf-c206-4e9b-802c-7dd67442a3af None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.338220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfbdbf-c206-4e9b-802c-7dd67442a3af None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.338605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974e584-1b17-44dc-b7f8-ba3f797bfd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.338748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfbdbf-c206-4e9b-802c-7dd67442a3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.338842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974e584-1b17-44dc-b7f8-ba3f797bfd9f admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.338842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974e584-1b17-44dc-b7f8-ba3f797bfd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.338842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974e584-1b17-44dc-b7f8-ba3f797bfd9f admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.339094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974e584-1b17-44dc-b7f8-ba3f797bfd9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.342085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974e584-1b17-44dc-b7f8-ba3f797bfd9f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.356442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-87cfbdbf-c206-4e9b-802c-7dd67442a3af None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:22.357821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-87cfbdbf-c206-4e9b-802c-7dd67442a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:22.364453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 803/1586] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:22 2021] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:22.365409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974e584-1b17-44dc-b7f8-ba3f797bfd9f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.371859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 784/1587] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:22.373080 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfbdbf-c206-4e9b-802c-7dd67442a3af None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.376390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974e584-1b17-44dc-b7f8-ba3f797bfd9f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.382142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2e812-7567-4b38-af31-7fbb3e40b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.383030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e812-7567-4b38-af31-7fbb3e40b700 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.383470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e812-7567-4b38-af31-7fbb3e40b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.384055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e812-7567-4b38-af31-7fbb3e40b700 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.384838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfbdbf-c206-4e9b-802c-7dd67442a3af None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.385006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2e812-7567-4b38-af31-7fbb3e40b700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.387067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2e812-7567-4b38-af31-7fbb3e40b700 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.389579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b457de5-e1bc-4fe6-b1f3-798c8e31428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.390302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457de5-e1bc-4fe6-b1f3-798c8e31428a admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.390583 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457de5-e1bc-4fe6-b1f3-798c8e31428a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.391107 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457de5-e1bc-4fe6-b1f3-798c8e31428a admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.392544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b457de5-e1bc-4fe6-b1f3-798c8e31428a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.394707 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b457de5-e1bc-4fe6-b1f3-798c8e31428a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.411232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 804/1588] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:22 2021] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:22.412179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2e812-7567-4b38-af31-7fbb3e40b700 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.422668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2e812-7567-4b38-af31-7fbb3e40b700 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.427644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca67a6-77c1-4ad4-b326-4335eba7ea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.428454 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca67a6-77c1-4ad4-b326-4335eba7ea58 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.428882 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca67a6-77c1-4ad4-b326-4335eba7ea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.429280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca67a6-77c1-4ad4-b326-4335eba7ea58 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.430802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca67a6-77c1-4ad4-b326-4335eba7ea58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.435140 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 785/1589] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:22 2021] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:22.435289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca67a6-77c1-4ad4-b326-4335eba7ea58 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.435387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b457de5-e1bc-4fe6-b1f3-798c8e31428a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.460667 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 805/1590] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:22 2021] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:22.461742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca67a6-77c1-4ad4-b326-4335eba7ea58 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.471997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca67a6-77c1-4ad4-b326-4335eba7ea58 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.514637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b457de5-e1bc-4fe6-b1f3-798c8e31428a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.520666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550868a0-eab2-45ac-9c1b-34313d5a88be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.521226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550868a0-eab2-45ac-9c1b-34313d5a88be admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.521513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550868a0-eab2-45ac-9c1b-34313d5a88be admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.522084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550868a0-eab2-45ac-9c1b-34313d5a88be admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.522879 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550868a0-eab2-45ac-9c1b-34313d5a88be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.526097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550868a0-eab2-45ac-9c1b-34313d5a88be admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.552424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b4aca-735c-4077-a90d-1b8fc92981d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.553403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b4aca-735c-4077-a90d-1b8fc92981d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.553988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b4aca-735c-4077-a90d-1b8fc92981d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.554901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b4aca-735c-4077-a90d-1b8fc92981d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.555182 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 786/1591] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:22 2021] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:22.556027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b4aca-735c-4077-a90d-1b8fc92981d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.556416 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550868a0-eab2-45ac-9c1b-34313d5a88be admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.558117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b4aca-735c-4077-a90d-1b8fc92981d9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.570524 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550868a0-eab2-45ac-9c1b-34313d5a88be admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.576565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46eb7e7-44c5-438d-8dd1-31d68d4f0902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.577454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eb7e7-44c5-438d-8dd1-31d68d4f0902 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.577949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eb7e7-44c5-438d-8dd1-31d68d4f0902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.578421 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eb7e7-44c5-438d-8dd1-31d68d4f0902 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.579176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46eb7e7-44c5-438d-8dd1-31d68d4f0902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.580958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46eb7e7-44c5-438d-8dd1-31d68d4f0902 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.582791 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 806/1592] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:22.583789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b4aca-735c-4077-a90d-1b8fc92981d9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.597323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 787/1593] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:22.598203 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46eb7e7-44c5-438d-8dd1-31d68d4f0902 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.608522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46eb7e7-44c5-438d-8dd1-31d68d4f0902 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.618798 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ec184-f07e-46f5-99ce-840b9c1cb9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.619497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec184-f07e-46f5-99ce-840b9c1cb9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.620101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec184-f07e-46f5-99ce-840b9c1cb9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.620385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec184-f07e-46f5-99ce-840b9c1cb9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.626063 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ec184-f07e-46f5-99ce-840b9c1cb9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.627705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ec184-f07e-46f5-99ce-840b9c1cb9d3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.642308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 788/1594] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:22.643716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ec184-f07e-46f5-99ce-840b9c1cb9d3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.659659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ec184-f07e-46f5-99ce-840b9c1cb9d3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.665436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ac640-0c32-4d39-b341-8ae23d282d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.666264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ac640-0c32-4d39-b341-8ae23d282d69 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.666577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ac640-0c32-4d39-b341-8ae23d282d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.666868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ac640-0c32-4d39-b341-8ae23d282d69 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.667554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ac640-0c32-4d39-b341-8ae23d282d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.669563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ac640-0c32-4d39-b341-8ae23d282d69 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.674265 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b4aca-735c-4077-a90d-1b8fc92981d9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.678640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07563a2d-9fed-4569-bee7-09c1366c8e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.680321 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07563a2d-9fed-4569-bee7-09c1366c8e41 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.680872 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07563a2d-9fed-4569-bee7-09c1366c8e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.681294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07563a2d-9fed-4569-bee7-09c1366c8e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.692619 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 789/1595] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:22 2021] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:22.693654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ac640-0c32-4d39-b341-8ae23d282d69 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.698852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07563a2d-9fed-4569-bee7-09c1366c8e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.700734 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07563a2d-9fed-4569-bee7-09c1366c8e41 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.706778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ac640-0c32-4d39-b341-8ae23d282d69 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.712064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75ee9b-66be-439b-b76b-c7b648e57583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.713241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75ee9b-66be-439b-b76b-c7b648e57583 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.713241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75ee9b-66be-439b-b76b-c7b648e57583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.713595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75ee9b-66be-439b-b76b-c7b648e57583 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.714359 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75ee9b-66be-439b-b76b-c7b648e57583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.716041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75ee9b-66be-439b-b76b-c7b648e57583 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.717601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 807/1596] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:22.718335 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07563a2d-9fed-4569-bee7-09c1366c8e41 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.727938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 790/1597] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:22.729084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75ee9b-66be-439b-b76b-c7b648e57583 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.730651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07563a2d-9fed-4569-bee7-09c1366c8e41 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.736401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c2976-51a3-4857-b601-fce4632568c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.737779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c2976-51a3-4857-b601-fce4632568c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.737779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c2976-51a3-4857-b601-fce4632568c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.737779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c2976-51a3-4857-b601-fce4632568c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.738456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c2976-51a3-4857-b601-fce4632568c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.739600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75ee9b-66be-439b-b76b-c7b648e57583 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.740060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c2976-51a3-4857-b601-fce4632568c6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.753804 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 808/1598] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:22.754026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180cf4b-3c98-4930-a460-d751d3cde23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.754176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c2976-51a3-4857-b601-fce4632568c6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.754274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180cf4b-3c98-4930-a460-d751d3cde23b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.754274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180cf4b-3c98-4930-a460-d751d3cde23b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.754274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180cf4b-3c98-4930-a460-d751d3cde23b admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.754274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180cf4b-3c98-4930-a460-d751d3cde23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.756074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180cf4b-3c98-4930-a460-d751d3cde23b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.771233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 791/1599] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:22.771233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180cf4b-3c98-4930-a460-d751d3cde23b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.771546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c2976-51a3-4857-b601-fce4632568c6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.777050 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ca3f9-ea7d-4f5a-af2b-61d57de6b974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.777937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ca3f9-ea7d-4f5a-af2b-61d57de6b974 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.778223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ca3f9-ea7d-4f5a-af2b-61d57de6b974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.778502 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ca3f9-ea7d-4f5a-af2b-61d57de6b974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.779234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ca3f9-ea7d-4f5a-af2b-61d57de6b974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.780827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ca3f9-ea7d-4f5a-af2b-61d57de6b974 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.790357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180cf4b-3c98-4930-a460-d751d3cde23b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.794744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 809/1600] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:22.795710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ca3f9-ea7d-4f5a-af2b-61d57de6b974 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.797350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2e01-ff55-44cf-8370-cb7dcfd36641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.798314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2e01-ff55-44cf-8370-cb7dcfd36641 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.798735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2e01-ff55-44cf-8370-cb7dcfd36641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.799210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2e01-ff55-44cf-8370-cb7dcfd36641 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.800143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab2e01-ff55-44cf-8370-cb7dcfd36641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.803560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab2e01-ff55-44cf-8370-cb7dcfd36641 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.806016 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ca3f9-ea7d-4f5a-af2b-61d57de6b974 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.811989 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b51b05-47f2-4fc9-a30f-92dbe64ddce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.812810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51b05-47f2-4fc9-a30f-92dbe64ddce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.813100 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51b05-47f2-4fc9-a30f-92dbe64ddce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.813426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51b05-47f2-4fc9-a30f-92dbe64ddce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.814352 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b51b05-47f2-4fc9-a30f-92dbe64ddce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.816216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b51b05-47f2-4fc9-a30f-92dbe64ddce2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.819782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 792/1601] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:22.821873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2e01-ff55-44cf-8370-cb7dcfd36641 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.831618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 810/1602] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:22.831618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b51b05-47f2-4fc9-a30f-92dbe64ddce2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.839831 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2e01-ff55-44cf-8370-cb7dcfd36641 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.846566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab3c43-861e-4e93-9e2b-b47a750f4ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.846855 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b51b05-47f2-4fc9-a30f-92dbe64ddce2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.848170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab3c43-861e-4e93-9e2b-b47a750f4ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.848738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab3c43-861e-4e93-9e2b-b47a750f4ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.849348 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab3c43-861e-4e93-9e2b-b47a750f4ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.850679 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab3c43-861e-4e93-9e2b-b47a750f4ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.852332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b882e6-c273-4cc1-b0a1-552a3202ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.853061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b882e6-c273-4cc1-b0a1-552a3202ae25 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.853388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b882e6-c273-4cc1-b0a1-552a3202ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.853667 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b882e6-c273-4cc1-b0a1-552a3202ae25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.854222 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab3c43-861e-4e93-9e2b-b47a750f4ae3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.854695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b882e6-c273-4cc1-b0a1-552a3202ae25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.856836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b882e6-c273-4cc1-b0a1-552a3202ae25 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.871291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 811/1603] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:22.871291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b882e6-c273-4cc1-b0a1-552a3202ae25 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.872193 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 793/1604] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:22.873221 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab3c43-861e-4e93-9e2b-b47a750f4ae3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.881942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b882e6-c273-4cc1-b0a1-552a3202ae25 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.887781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab3c43-861e-4e93-9e2b-b47a750f4ae3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:22.888275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e90172-0761-4787-96ee-366f8ce3072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.889230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e90172-0761-4787-96ee-366f8ce3072a admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.889675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e90172-0761-4787-96ee-366f8ce3072a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.890001 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e90172-0761-4787-96ee-366f8ce3072a admin admin] PATH_INFO: `/v3/projects/50ca8c7ca2f54cb5b0a25504cfc6d46e/users/74f550b4fd094249af19a73177584950/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.894547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cc275-666a-4cbe-86b1-40a3bb565dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:22.895510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cc275-666a-4cbe-86b1-40a3bb565dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:22.895857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cc275-666a-4cbe-86b1-40a3bb565dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:22.896195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cc275-666a-4cbe-86b1-40a3bb565dbd admin admin] PATH_INFO: `/v3/projects/a9e5c8d84d63416aa50961ac229d72b7/users/d18df8d5cf1c44efbefd2b7e008a33c4/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:22.913501 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e90172-0761-4787-96ee-366f8ce3072a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ca8c7ca2f54cb5b0a25504cfc6d46e, user_id=74f550b4fd094249af19a73177584950, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.916788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e90172-0761-4787-96ee-366f8ce3072a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.918741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cc275-666a-4cbe-86b1-40a3bb565dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e5c8d84d63416aa50961ac229d72b7, user_id=d18df8d5cf1c44efbefd2b7e008a33c4, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:22.921393 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cc275-666a-4cbe-86b1-40a3bb565dbd admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:22.939994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 794/1605] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:22 2021] PUT /identity/v3/projects/a9e5c8d84d63416aa50961ac229d72b7/users/d18df8d5cf1c44efbefd2b7e008a33c4/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:22.941191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cc275-666a-4cbe-86b1-40a3bb565dbd admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:22.947904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 812/1606] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:22 2021] PUT /identity/v3/projects/50ca8c7ca2f54cb5b0a25504cfc6d46e/users/74f550b4fd094249af19a73177584950/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:22.949012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e90172-0761-4787-96ee-366f8ce3072a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:23.044246 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cc275-666a-4cbe-86b1-40a3bb565dbd admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:23.047843 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e90172-0761-4787-96ee-366f8ce3072a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:23.051598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ef05-35f5-4cca-9150-5a1d61a88282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:23.052863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ef05-35f5-4cca-9150-5a1d61a88282 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.053400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ef05-35f5-4cca-9150-5a1d61a88282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.053684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ef05-35f5-4cca-9150-5a1d61a88282 admin admin] PATH_INFO: `/v3/projects/25f2e50e7e8043f2bf9e8a68b5c2a7b5/users/6162b9a641804f898d4971cd94006717/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.058485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1a0c2-bc29-4db5-93dd-87e07837425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:23.059183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a0c2-bc29-4db5-93dd-87e07837425d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.059520 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a0c2-bc29-4db5-93dd-87e07837425d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.059903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a0c2-bc29-4db5-93dd-87e07837425d admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.060915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1a0c2-bc29-4db5-93dd-87e07837425d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:23.062692 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1a0c2-bc29-4db5-93dd-87e07837425d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:23.074574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ef05-35f5-4cca-9150-5a1d61a88282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f2e50e7e8043f2bf9e8a68b5c2a7b5, user_id=6162b9a641804f898d4971cd94006717, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:23.075075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 813/1607] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:23.075921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1a0c2-bc29-4db5-93dd-87e07837425d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:23.081674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ef05-35f5-4cca-9150-5a1d61a88282 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:23.089510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1a0c2-bc29-4db5-93dd-87e07837425d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:23.096212 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9515683-2702-46f0-a8a6-327aa0f7962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:23.097189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9515683-2702-46f0-a8a6-327aa0f7962e admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.097690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9515683-2702-46f0-a8a6-327aa0f7962e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.098339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9515683-2702-46f0-a8a6-327aa0f7962e admin admin] PATH_INFO: `/v3/projects/d7e37b2e123847f08bbe4fb9d757013b/users/8231d80b11064b848befd510c02d627a/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.100643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 795/1608] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:22 2021] PUT /identity/v3/projects/25f2e50e7e8043f2bf9e8a68b5c2a7b5/users/6162b9a641804f898d4971cd94006717/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:23.102388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ef05-35f5-4cca-9150-5a1d61a88282 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:23.117687 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9515683-2702-46f0-a8a6-327aa0f7962e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e37b2e123847f08bbe4fb9d757013b, user_id=8231d80b11064b848befd510c02d627a, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:23.120831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9515683-2702-46f0-a8a6-327aa0f7962e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:23.146963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 814/1609] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:23 2021] PUT /identity/v3/projects/d7e37b2e123847f08bbe4fb9d757013b/users/8231d80b11064b848befd510c02d627a/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:23.148701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a67a0-3a78-4d59-a9b3-0b708089e85a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.149055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a67a0-3a78-4d59-a9b3-0b708089e85a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.149598 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a67a0-3a78-4d59-a9b3-0b708089e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.180930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-186a67a0-3a78-4d59-a9b3-0b708089e85a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:23.184441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-186a67a0-3a78-4d59-a9b3-0b708089e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:23.187611 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ef05-35f5-4cca-9150-5a1d61a88282 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:23.290607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 815/1610] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:23.295458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288abd6-64b3-47d2-89f6-86e3178438b7 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.295884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288abd6-64b3-47d2-89f6-86e3178438b7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.296003 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288abd6-64b3-47d2-89f6-86e3178438b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.307741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef1f0-0cfe-48a5-9c20-895b7615b906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:23.308666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef1f0-0cfe-48a5-9c20-895b7615b906 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.309008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef1f0-0cfe-48a5-9c20-895b7615b906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.309286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef1f0-0cfe-48a5-9c20-895b7615b906 admin admin] PATH_INFO: `/v3/projects/cbc3fb62e6fd4e12b55c29b671482f9d/users/84d42046f04e4d819193d705bf4557f4/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.327463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ef1f0-0cfe-48a5-9c20-895b7615b906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc3fb62e6fd4e12b55c29b671482f9d, user_id=84d42046f04e4d819193d705bf4557f4, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:23.330542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ef1f0-0cfe-48a5-9c20-895b7615b906 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:23.358378 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 796/1611] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:23 2021] PUT /identity/v3/projects/cbc3fb62e6fd4e12b55c29b671482f9d/users/84d42046f04e4d819193d705bf4557f4/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:23.359590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef1f0-0cfe-48a5-9c20-895b7615b906 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:23.359962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-9288abd6-64b3-47d2-89f6-86e3178438b7 None None] MFA Rules not processed for user `74f550b4fd094249af19a73177584950`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:23.361245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9288abd6-64b3-47d2-89f6-86e3178438b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:23.479684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 816/1612] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:23 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:23.482102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d9ce-1325-4034-8ab7-eab4d7ca245a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.482387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d9ce-1325-4034-8ab7-eab4d7ca245a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.482661 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d9ce-1325-4034-8ab7-eab4d7ca245a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.500858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef1f0-0cfe-48a5-9c20-895b7615b906 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:23.512542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3534d-acc0-41f8-998e-ecdb33b6a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:23.513453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3534d-acc0-41f8-998e-ecdb33b6a97f admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.513730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3534d-acc0-41f8-998e-ecdb33b6a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.514080 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3534d-acc0-41f8-998e-ecdb33b6a97f admin admin] PATH_INFO: `/v3/projects/11b9bbd249ae4b4db4324b5f2223a374/users/1bc6685f480242af9008b984d63ecd4c/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.527610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-88f3d9ce-1325-4034-8ab7-eab4d7ca245a None None] MFA Rules not processed for user `6162b9a641804f898d4971cd94006717`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:23.528927 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-88f3d9ce-1325-4034-8ab7-eab4d7ca245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:23.550028 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3534d-acc0-41f8-998e-ecdb33b6a97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b9bbd249ae4b4db4324b5f2223a374, user_id=1bc6685f480242af9008b984d63ecd4c, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:23.553102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3534d-acc0-41f8-998e-ecdb33b6a97f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:23.587448 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 797/1613] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:23 2021] PUT /identity/v3/projects/11b9bbd249ae4b4db4324b5f2223a374/users/1bc6685f480242af9008b984d63ecd4c/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:23.589298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2d7aa-d383-472d-aaf7-61a4848c4c73 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.589726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2d7aa-d383-472d-aaf7-61a4848c4c73 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.590263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2d7aa-d383-472d-aaf7-61a4848c4c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.672231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-61f2d7aa-d383-472d-aaf7-61a4848c4c73 None None] MFA Rules not processed for user `8231d80b11064b848befd510c02d627a`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:23.673636 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-61f2d7aa-d383-472d-aaf7-61a4848c4c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:23.709135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 817/1614] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:23.710899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3d9ce-1325-4034-8ab7-eab4d7ca245a None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:23.796574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 798/1615] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:23 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:23.800908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f057950-b60d-4168-be8d-00c48ec1175b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.801146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f057950-b60d-4168-be8d-00c48ec1175b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.802772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3d9ce-1325-4034-8ab7-eab4d7ca245a None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:23.803244 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f057950-b60d-4168-be8d-00c48ec1175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.848441 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-8f057950-b60d-4168-be8d-00c48ec1175b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:23.852849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8f057950-b60d-4168-be8d-00c48ec1175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:23.881932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39db640-fea2-4a79-88e2-87fd9939952a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:23.888409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39db640-fea2-4a79-88e2-87fd9939952a service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:23.888686 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39db640-fea2-4a79-88e2-87fd9939952a service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:23.889026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39db640-fea2-4a79-88e2-87fd9939952a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:23.979138 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 799/1616] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:23.983131 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f057950-b60d-4168-be8d-00c48ec1175b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:23.985584 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39db640-fea2-4a79-88e2-87fd9939952a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:23.988899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39db640-fea2-4a79-88e2-87fd9939952a service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.002706 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 818/1617] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:24.004421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c7d78-4536-4fb1-9862-1f202972d5f8 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.004421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c7d78-4536-4fb1-9862-1f202972d5f8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.004687 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c7d78-4536-4fb1-9862-1f202972d5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.009206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f057950-b60d-4168-be8d-00c48ec1175b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.031659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca565dcc-846e-4e86-8ae1-d600785ba539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.032771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca565dcc-846e-4e86-8ae1-d600785ba539 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.033169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca565dcc-846e-4e86-8ae1-d600785ba539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.033574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca565dcc-846e-4e86-8ae1-d600785ba539 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.034616 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca565dcc-846e-4e86-8ae1-d600785ba539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.037598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca565dcc-846e-4e86-8ae1-d600785ba539 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.044389 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-ab8c7d78-4536-4fb1-9862-1f202972d5f8 None None] MFA Rules not processed for user `1bc6685f480242af9008b984d63ecd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:24.045711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ab8c7d78-4536-4fb1-9862-1f202972d5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:24.082766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 800/1618] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:23 2021] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:24.083580 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca565dcc-846e-4e86-8ae1-d600785ba539 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.136344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 819/1619] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:24 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:24.136344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b118f-a301-4191-a4f3-bb79ae01bb89 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.136344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b118f-a301-4191-a4f3-bb79ae01bb89 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.136344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b118f-a301-4191-a4f3-bb79ae01bb89 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.136344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 820/1620] 10.222.0.83 () {54 vars in 961 bytes} [Wed Dec 15 13:36:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:36:24.136905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b118f-a301-4191-a4f3-bb79ae01bb89 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.174627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca565dcc-846e-4e86-8ae1-d600785ba539 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.186230 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e3340-311a-4e3c-a3ea-3205a5fe05e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.186912 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3340-311a-4e3c-a3ea-3205a5fe05e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.187196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3340-311a-4e3c-a3ea-3205a5fe05e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.187474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3340-311a-4e3c-a3ea-3205a5fe05e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.188191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e3340-311a-4e3c-a3ea-3205a5fe05e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.190144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e3340-311a-4e3c-a3ea-3205a5fe05e6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.225535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b118f-a301-4191-a4f3-bb79ae01bb89 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.231574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e672449-75cf-4ad1-ab7e-bc4c7bfac6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.233145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e672449-75cf-4ad1-ab7e-bc4c7bfac6eb service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.233145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e672449-75cf-4ad1-ab7e-bc4c7bfac6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.233346 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e672449-75cf-4ad1-ab7e-bc4c7bfac6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.245665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 801/1621] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:24 2021] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:24.247632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e3340-311a-4e3c-a3ea-3205a5fe05e6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.249339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e672449-75cf-4ad1-ab7e-bc4c7bfac6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.250848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e672449-75cf-4ad1-ab7e-bc4c7bfac6eb service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.271294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 821/1622] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:24.273242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82c0ee-c58e-4cf7-a865-3984b9b811a9 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.273742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82c0ee-c58e-4cf7-a865-3984b9b811a9 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.274762 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82c0ee-c58e-4cf7-a865-3984b9b811a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.298816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-af82c0ee-c58e-4cf7-a865-3984b9b811a9 None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:24.300209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-af82c0ee-c58e-4cf7-a865-3984b9b811a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:24.337648 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e3340-311a-4e3c-a3ea-3205a5fe05e6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.344108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a097d-161a-4241-8787-212f23c8a8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.344935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a097d-161a-4241-8787-212f23c8a8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.345312 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a097d-161a-4241-8787-212f23c8a8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.345715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a097d-161a-4241-8787-212f23c8a8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.346617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a097d-161a-4241-8787-212f23c8a8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.348961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a097d-161a-4241-8787-212f23c8a8b0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.380236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 802/1623] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:24 2021] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:24.380236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff5e1-8c4d-4e82-a1a3-428fe32379df None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.380236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff5e1-8c4d-4e82-a1a3-428fe32379df None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.380236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff5e1-8c4d-4e82-a1a3-428fe32379df None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.382442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 803/1624] 10.222.0.83 () {54 vars in 961 bytes} [Wed Dec 15 13:36:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:36:24.390665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ff5e1-8c4d-4e82-a1a3-428fe32379df None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.416713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ff5e1-8c4d-4e82-a1a3-428fe32379df None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.425532 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240c106-b2ca-453b-be05-12120764be6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.426481 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240c106-b2ca-453b-be05-12120764be6f admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.426765 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240c106-b2ca-453b-be05-12120764be6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.427039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240c106-b2ca-453b-be05-12120764be6f admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.427823 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240c106-b2ca-453b-be05-12120764be6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.430598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240c106-b2ca-453b-be05-12120764be6f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.448873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 822/1625] 10.222.0.83 () {58 vars in 1058 bytes} [Wed Dec 15 13:36:24 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:24.449939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82c0ee-c58e-4cf7-a865-3984b9b811a9 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.463794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82c0ee-c58e-4cf7-a865-3984b9b811a9 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.472589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 804/1626] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:24 2021] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:24.472589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161741c-e6a5-462a-a38b-fa17c2063488 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.472589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161741c-e6a5-462a-a38b-fa17c2063488 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.472589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161741c-e6a5-462a-a38b-fa17c2063488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.474095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58beb4f-7de5-4e27-86a6-2116574619f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.474914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58beb4f-7de5-4e27-86a6-2116574619f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.475267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58beb4f-7de5-4e27-86a6-2116574619f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.475612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58beb4f-7de5-4e27-86a6-2116574619f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.477172 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58beb4f-7de5-4e27-86a6-2116574619f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.479347 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58beb4f-7de5-4e27-86a6-2116574619f8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.496549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 823/1627] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:24 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:24.500244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58beb4f-7de5-4e27-86a6-2116574619f8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.512839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e161741c-e6a5-462a-a38b-fa17c2063488 None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:24.514318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e161741c-e6a5-462a-a38b-fa17c2063488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:24.525927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 805/1628] 10.222.0.83 () {58 vars in 1058 bytes} [Wed Dec 15 13:36:24 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:24.526829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161741c-e6a5-462a-a38b-fa17c2063488 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.530895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58beb4f-7de5-4e27-86a6-2116574619f8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.540331 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161741c-e6a5-462a-a38b-fa17c2063488 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.543125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829b4f8-cca9-4600-8475-0b81eb14a4b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.543801 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829b4f8-cca9-4600-8475-0b81eb14a4b5 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.544087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829b4f8-cca9-4600-8475-0b81eb14a4b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.544368 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829b4f8-cca9-4600-8475-0b81eb14a4b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.553199 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a40e73-4b05-4ba9-9b38-81df6db7dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.554213 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40e73-4b05-4ba9-9b38-81df6db7dd42 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.555057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40e73-4b05-4ba9-9b38-81df6db7dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.555346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40e73-4b05-4ba9-9b38-81df6db7dd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.556180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a40e73-4b05-4ba9-9b38-81df6db7dd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.558035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a40e73-4b05-4ba9-9b38-81df6db7dd42 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.570992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 806/1629] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:24 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:24.571934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a40e73-4b05-4ba9-9b38-81df6db7dd42 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.583554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a40e73-4b05-4ba9-9b38-81df6db7dd42 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.591361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d119099-26aa-4105-8752-afcf74b4128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.592278 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119099-26aa-4105-8752-afcf74b4128c admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.592557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119099-26aa-4105-8752-afcf74b4128c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.592949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119099-26aa-4105-8752-afcf74b4128c admin admin] PATH_INFO: `/v3/projects/749c0594f80f452da08f51d9a9173a1a/users/23aeed58917c47fdbfe6d0b2800e6374/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.612139 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d119099-26aa-4105-8752-afcf74b4128c admin admin] RBAC: Authorizing `identity:create_grant(project_id=749c0594f80f452da08f51d9a9173a1a, user_id=23aeed58917c47fdbfe6d0b2800e6374, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.615337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d119099-26aa-4105-8752-afcf74b4128c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.642950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 807/1630] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:24 2021] PUT /identity/v3/projects/749c0594f80f452da08f51d9a9173a1a/users/23aeed58917c47fdbfe6d0b2800e6374/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:24.643996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d119099-26aa-4105-8752-afcf74b4128c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.688634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829b4f8-cca9-4600-8475-0b81eb14a4b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.691285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829b4f8-cca9-4600-8475-0b81eb14a4b5 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.708708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 824/1631] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:24 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:24.710130 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829b4f8-cca9-4600-8475-0b81eb14a4b5 service nova] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:24.730228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829b4f8-cca9-4600-8475-0b81eb14a4b5 service nova] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.839340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d119099-26aa-4105-8752-afcf74b4128c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:24.864557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdde477-8829-41c4-87e9-6f9e224a4b37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.865425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdde477-8829-41c4-87e9-6f9e224a4b37 service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.865794 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdde477-8829-41c4-87e9-6f9e224a4b37 service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.866143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdde477-8829-41c4-87e9-6f9e224a4b37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.912338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872bbba-6043-4514-a064-e235158e264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:24.914565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872bbba-6043-4514-a064-e235158e264e admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:24.918530 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872bbba-6043-4514-a064-e235158e264e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:24.919137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872bbba-6043-4514-a064-e235158e264e admin admin] PATH_INFO: `/v3/projects/a56e89e7c17841c1bbe0d709d68ab684/users/de48470bf8704989a2877757d18da689/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:24.970473 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872bbba-6043-4514-a064-e235158e264e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56e89e7c17841c1bbe0d709d68ab684, user_id=de48470bf8704989a2877757d18da689, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.975593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdde477-8829-41c4-87e9-6f9e224a4b37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:24.978078 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872bbba-6043-4514-a064-e235158e264e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.978691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdde477-8829-41c4-87e9-6f9e224a4b37 service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:24.999431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 808/1632] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:24 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:25.003165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdde477-8829-41c4-87e9-6f9e224a4b37 service nova] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:25.020702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 825/1633] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:24 2021] PUT /identity/v3/projects/a56e89e7c17841c1bbe0d709d68ab684/users/de48470bf8704989a2877757d18da689/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:25.025286 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872bbba-6043-4514-a064-e235158e264e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:25.032095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdde477-8829-41c4-87e9-6f9e224a4b37 service nova] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:25.154169 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872bbba-6043-4514-a064-e235158e264e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:25.166451 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061357b3-79c3-4d49-ab61-47038ac2ad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:25.167136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061357b3-79c3-4d49-ab61-47038ac2ad3e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.167419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061357b3-79c3-4d49-ab61-47038ac2ad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.167864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061357b3-79c3-4d49-ab61-47038ac2ad3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.168437 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061357b3-79c3-4d49-ab61-47038ac2ad3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:25.170223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061357b3-79c3-4d49-ab61-47038ac2ad3e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:25.185409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 826/1634] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:25 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:36:25.187501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbff73-95e8-48b0-8680-c7a41ef2c67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:25.188391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbff73-95e8-48b0-8680-c7a41ef2c67f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.188678 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbff73-95e8-48b0-8680-c7a41ef2c67f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.188958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbff73-95e8-48b0-8680-c7a41ef2c67f admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.189156 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061357b3-79c3-4d49-ab61-47038ac2ad3e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:25.193627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbff73-95e8-48b0-8680-c7a41ef2c67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:25.199545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbff73-95e8-48b0-8680-c7a41ef2c67f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:25.206483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061357b3-79c3-4d49-ab61-47038ac2ad3e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:25.222322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42e59c-d0fb-4846-b427-c340e405d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:25.223296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e59c-d0fb-4846-b427-c340e405d116 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.223580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e59c-d0fb-4846-b427-c340e405d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.223859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e59c-d0fb-4846-b427-c340e405d116 admin admin] PATH_INFO: `/v3/projects/a56e89e7c17841c1bbe0d709d68ab684/users/de48470bf8704989a2877757d18da689/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.233204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42e59c-d0fb-4846-b427-c340e405d116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56e89e7c17841c1bbe0d709d68ab684, user_id=de48470bf8704989a2877757d18da689, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:25.236035 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42e59c-d0fb-4846-b427-c340e405d116 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:25.236345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 809/1635] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:24 2021] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:25.238230 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbff73-95e8-48b0-8680-c7a41ef2c67f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:25.258952 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 827/1636] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:25 2021] PUT /identity/v3/projects/a56e89e7c17841c1bbe0d709d68ab684/users/de48470bf8704989a2877757d18da689/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:25.262342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbff73-95e8-48b0-8680-c7a41ef2c67f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:25.269469 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6dcbb-7a5b-4e14-aa1e-84e4ca6735d9 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.269780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6dcbb-7a5b-4e14-aa1e-84e4ca6735d9 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.270065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6dcbb-7a5b-4e14-aa1e-84e4ca6735d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.329214 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-4ee6dcbb-7a5b-4e14-aa1e-84e4ca6735d9 None None] MFA Rules not processed for user `de48470bf8704989a2877757d18da689`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:25.333852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4ee6dcbb-7a5b-4e14-aa1e-84e4ca6735d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:25.464602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c83f4-1157-4848-96b3-310a7d50825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:25.464602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c83f4-1157-4848-96b3-310a7d50825c admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.464602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c83f4-1157-4848-96b3-310a7d50825c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.464602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c83f4-1157-4848-96b3-310a7d50825c admin admin] PATH_INFO: `/v3/projects/749c0594f80f452da08f51d9a9173a1a/users/23aeed58917c47fdbfe6d0b2800e6374/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.470737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c83f4-1157-4848-96b3-310a7d50825c admin admin] RBAC: Authorizing `identity:create_grant(project_id=749c0594f80f452da08f51d9a9173a1a, user_id=23aeed58917c47fdbfe6d0b2800e6374, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:25.473569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c83f4-1157-4848-96b3-310a7d50825c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:25.506411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 810/1637] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:25 2021] PUT /identity/v3/projects/749c0594f80f452da08f51d9a9173a1a/users/23aeed58917c47fdbfe6d0b2800e6374/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:25.508009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b8417-be87-476a-84d2-7971d5bf839d None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.508294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b8417-be87-476a-84d2-7971d5bf839d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.508569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b8417-be87-476a-84d2-7971d5bf839d None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.515620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 811/1638] 10.222.0.83 () {54 vars in 912 bytes} [Wed Dec 15 13:36:25 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:36:25.516940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d472a6a-f5da-4d40-89fb-d4f250451430 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.517274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d472a6a-f5da-4d40-89fb-d4f250451430 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.517554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d472a6a-f5da-4d40-89fb-d4f250451430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.523739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 828/1639] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:25 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:25.525347 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356998d-aad2-4c95-bb5d-2490a65c060b None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.525647 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356998d-aad2-4c95-bb5d-2490a65c060b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.526323 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356998d-aad2-4c95-bb5d-2490a65c060b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.573069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-9356998d-aad2-4c95-bb5d-2490a65c060b None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:25.577359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9356998d-aad2-4c95-bb5d-2490a65c060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:25.591347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-8d472a6a-f5da-4d40-89fb-d4f250451430 None None] MFA Rules not processed for user `23aeed58917c47fdbfe6d0b2800e6374`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:25.593694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8d472a6a-f5da-4d40-89fb-d4f250451430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:25.734088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 829/1640] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:36:25 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:25.735250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356998d-aad2-4c95-bb5d-2490a65c060b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:25.748521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 812/1641] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:25 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:25.750205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a149d4-f22d-46ce-ad7d-a573396519c3 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.750668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a149d4-f22d-46ce-ad7d-a573396519c3 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.751096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a149d4-f22d-46ce-ad7d-a573396519c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.800753 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e2a149d4-f22d-46ce-ad7d-a573396519c3 None None] MFA Rules not processed for user `84d42046f04e4d819193d705bf4557f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:25.803196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e2a149d4-f22d-46ce-ad7d-a573396519c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:25.812099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356998d-aad2-4c95-bb5d-2490a65c060b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:25.818731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb282176-6614-4b03-b7c1-6856029e6b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:25.819470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282176-6614-4b03-b7c1-6856029e6b5c service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.819972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282176-6614-4b03-b7c1-6856029e6b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.820339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282176-6614-4b03-b7c1-6856029e6b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.918748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 813/1642] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:25 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:25.920924 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd1997-8091-4ff1-8475-5b0428e7fd52 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.921397 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd1997-8091-4ff1-8475-5b0428e7fd52 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.921863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd1997-8091-4ff1-8475-5b0428e7fd52 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.923866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 814/1643] 10.222.0.83 () {54 vars in 912 bytes} [Wed Dec 15 13:36:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:36:25.929214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd1997-8091-4ff1-8475-5b0428e7fd52 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:25.953954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd1997-8091-4ff1-8475-5b0428e7fd52 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:25.954665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb282176-6614-4b03-b7c1-6856029e6b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:25.956317 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb282176-6614-4b03-b7c1-6856029e6b5c service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:25.964444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30352b96-fb58-4f09-990f-d93289c367f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:25.965408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30352b96-fb58-4f09-990f-d93289c367f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.966506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30352b96-fb58-4f09-990f-d93289c367f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.968248 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30352b96-fb58-4f09-990f-d93289c367f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.968915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 830/1644] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:25 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:25.982220 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584a3de-e115-41a5-9643-c6429b6a9ba8 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:25.984348 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584a3de-e115-41a5-9643-c6429b6a9ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:25.984791 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584a3de-e115-41a5-9643-c6429b6a9ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:25.993173 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30352b96-fb58-4f09-990f-d93289c367f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:25.995260 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30352b96-fb58-4f09-990f-d93289c367f6 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:26.029416 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 815/1645] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:25 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:26.030824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b976-d879-406c-a634-d2fffa45f49b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:26.031115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b976-d879-406c-a634-d2fffa45f49b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:26.032711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b976-d879-406c-a634-d2fffa45f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:26.037330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2584a3de-e115-41a5-9643-c6429b6a9ba8 None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:26.039635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2584a3de-e115-41a5-9643-c6429b6a9ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:26.060415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 831/1646] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:36:25 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:26.067479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584a3de-e115-41a5-9643-c6429b6a9ba8 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:26.085328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-fd80b976-d879-406c-a634-d2fffa45f49b None None] MFA Rules not processed for user `84d42046f04e4d819193d705bf4557f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:26.087357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fd80b976-d879-406c-a634-d2fffa45f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:26.095100 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584a3de-e115-41a5-9643-c6429b6a9ba8 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:26.104820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a13d6-1a58-4a48-b0a7-04ce333cea7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:26.105676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a13d6-1a58-4a48-b0a7-04ce333cea7e service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:26.105989 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a13d6-1a58-4a48-b0a7-04ce333cea7e service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:26.106324 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a13d6-1a58-4a48-b0a7-04ce333cea7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:26.115280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 816/1647] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:26 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:26.141491 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a13d6-1a58-4a48-b0a7-04ce333cea7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:26.143451 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a13d6-1a58-4a48-b0a7-04ce333cea7e service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:26.173186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 832/1648] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:26 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:26.306713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80b976-d879-406c-a634-d2fffa45f49b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:26.324710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80b976-d879-406c-a634-d2fffa45f49b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:26.334964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5ab43-d58d-4789-9e28-f4e119c0f72c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:26.339814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5ab43-d58d-4789-9e28-f4e119c0f72c service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:26.340811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5ab43-d58d-4789-9e28-f4e119c0f72c service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:26.341275 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5ab43-d58d-4789-9e28-f4e119c0f72c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:26.359755 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5ab43-d58d-4789-9e28-f4e119c0f72c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:26.361684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5ab43-d58d-4789-9e28-f4e119c0f72c service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:26.381030 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 817/1649] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:26.431200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2aa63-9408-488f-9b31-08fc7ce93ae1 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:26.431776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2aa63-9408-488f-9b31-08fc7ce93ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:26.432248 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2aa63-9408-488f-9b31-08fc7ce93ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:26.466408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2ab2aa63-9408-488f-9b31-08fc7ce93ae1 None None] MFA Rules not processed for user `d18df8d5cf1c44efbefd2b7e008a33c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:26.468083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2ab2aa63-9408-488f-9b31-08fc7ce93ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:26.577093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 833/1650] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:26 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:26.577736 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5ab43-d58d-4789-9e28-f4e119c0f72c service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:26.699725 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5ab43-d58d-4789-9e28-f4e119c0f72c service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:26.716883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a2c3b-6005-4ad5-a90a-801d94ec824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:26.717579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a2c3b-6005-4ad5-a90a-801d94ec824f admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:26.717894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a2c3b-6005-4ad5-a90a-801d94ec824f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:26.718175 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a2c3b-6005-4ad5-a90a-801d94ec824f admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:26.718903 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a2c3b-6005-4ad5-a90a-801d94ec824f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:26.729621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a2c3b-6005-4ad5-a90a-801d94ec824f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:26.796338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 818/1651] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:26 2021] POST /identity/v3/projects => generated 401 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:26.800188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2aa63-9408-488f-9b31-08fc7ce93ae1 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:26.824810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2aa63-9408-488f-9b31-08fc7ce93ae1 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:26.922235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a2c3b-6005-4ad5-a90a-801d94ec824f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:26.971288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84241b0a-cbec-4687-bc0b-353097c28080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:26.972025 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241b0a-cbec-4687-bc0b-353097c28080 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:26.972308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241b0a-cbec-4687-bc0b-353097c28080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:26.972581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241b0a-cbec-4687-bc0b-353097c28080 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:26.973306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84241b0a-cbec-4687-bc0b-353097c28080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:26.975621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84241b0a-cbec-4687-bc0b-353097c28080 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:27.001435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a2c3b-6005-4ad5-a90a-801d94ec824f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:27.007421 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb191bc5-212a-4c79-9459-feae57d9a52f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:27.008415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191bc5-212a-4c79-9459-feae57d9a52f service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:27.008755 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191bc5-212a-4c79-9459-feae57d9a52f service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:27.009084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191bc5-212a-4c79-9459-feae57d9a52f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:27.031180 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 834/1652] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:26 2021] POST /identity/v3/users => generated 307 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:27.037208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84241b0a-cbec-4687-bc0b-353097c28080 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:27.058938 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84241b0a-cbec-4687-bc0b-353097c28080 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:27.066772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa960de-07d6-4499-85d9-1ed01dc5d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:27.067757 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa960de-07d6-4499-85d9-1ed01dc5d172 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:27.068308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa960de-07d6-4499-85d9-1ed01dc5d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:27.068766 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa960de-07d6-4499-85d9-1ed01dc5d172 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:27.069794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa960de-07d6-4499-85d9-1ed01dc5d172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:27.073820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa960de-07d6-4499-85d9-1ed01dc5d172 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:27.105987 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 835/1653] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:27 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:27.112857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa960de-07d6-4499-85d9-1ed01dc5d172 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:27.136811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa960de-07d6-4499-85d9-1ed01dc5d172 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:27.138690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb191bc5-212a-4c79-9459-feae57d9a52f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:27.140139 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb191bc5-212a-4c79-9459-feae57d9a52f service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:27.145426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739434fb-4e89-4f11-a30d-05cef141e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:27.146576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739434fb-4e89-4f11-a30d-05cef141e5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:27.147021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739434fb-4e89-4f11-a30d-05cef141e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:27.147441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739434fb-4e89-4f11-a30d-05cef141e5bf admin admin] PATH_INFO: `/v3/projects/ca3a9bad323342759de5429e878212ce/users/7f7ab9d46c1842a7ae73dc1f43835d12/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:27.160199 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 819/1654] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:26 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:36:27.204763 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739434fb-4e89-4f11-a30d-05cef141e5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3a9bad323342759de5429e878212ce, user_id=7f7ab9d46c1842a7ae73dc1f43835d12, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:27.227215 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb191bc5-212a-4c79-9459-feae57d9a52f service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:27.235845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739434fb-4e89-4f11-a30d-05cef141e5bf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:27.278600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 836/1655] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:27 2021] PUT /identity/v3/projects/ca3a9bad323342759de5429e878212ce/users/7f7ab9d46c1842a7ae73dc1f43835d12/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:27.283338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739434fb-4e89-4f11-a30d-05cef141e5bf admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:27.473266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb191bc5-212a-4c79-9459-feae57d9a52f service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:27.513696 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739434fb-4e89-4f11-a30d-05cef141e5bf admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:27.543307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831988d-a10b-4621-a268-fb84ec5ecb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:27.543307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831988d-a10b-4621-a268-fb84ec5ecb24 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:27.543307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831988d-a10b-4621-a268-fb84ec5ecb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:27.543307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831988d-a10b-4621-a268-fb84ec5ecb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:27.543858 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831988d-a10b-4621-a268-fb84ec5ecb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:27.543858 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831988d-a10b-4621-a268-fb84ec5ecb24 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:27.590873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 837/1656] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:27 2021] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:27.595407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831988d-a10b-4621-a268-fb84ec5ecb24 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:27.634725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831988d-a10b-4621-a268-fb84ec5ecb24 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:27.661252 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b548704-3891-4308-a599-abaa5dd1dc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:27.663048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b548704-3891-4308-a599-abaa5dd1dc67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:27.663048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b548704-3891-4308-a599-abaa5dd1dc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:27.663048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b548704-3891-4308-a599-abaa5dd1dc67 admin admin] PATH_INFO: `/v3/projects/ca3a9bad323342759de5429e878212ce/users/7f7ab9d46c1842a7ae73dc1f43835d12/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:27.676557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b548704-3891-4308-a599-abaa5dd1dc67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3a9bad323342759de5429e878212ce, user_id=7f7ab9d46c1842a7ae73dc1f43835d12, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:27.678835 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b548704-3891-4308-a599-abaa5dd1dc67 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:27.704217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351617c-910a-4a0d-b84e-c606c55389bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:27.705584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351617c-910a-4a0d-b84e-c606c55389bc service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:27.705906 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351617c-910a-4a0d-b84e-c606c55389bc service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:27.706183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351617c-910a-4a0d-b84e-c606c55389bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:27.738032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 838/1657] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:27 2021] PUT /identity/v3/projects/ca3a9bad323342759de5429e878212ce/users/7f7ab9d46c1842a7ae73dc1f43835d12/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:27.765147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b548704-3891-4308-a599-abaa5dd1dc67 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:27.789330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351617c-910a-4a0d-b84e-c606c55389bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:27.791169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351617c-910a-4a0d-b84e-c606c55389bc service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:27.808101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 820/1658] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:27 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:36:27.879443 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b548704-3891-4308-a599-abaa5dd1dc67 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:27.885223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:27.886295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:27.886581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:27.886917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] PATH_INFO: `/v3/users/74f550b4fd094249af19a73177584950` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:27.888351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f550b4fd094249af19a73177584950)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:27.890606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:27.958786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f550b4fd094249af19a73177584950'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:27.971042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f550b4fd094249af19a73177584950'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:27.977176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f550b4fd094249af19a73177584950'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:27.994105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f550b4fd094249af19a73177584950'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:27.995011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f550b4fd094249af19a73177584950'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:28.015284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 839/1659] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:27 2021] DELETE /identity/v3/users/74f550b4fd094249af19a73177584950 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:28.020465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224811d-74c8-44f9-bbbd-48324e4f8f1e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:28.021033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224811d-74c8-44f9-bbbd-48324e4f8f1e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:28.021420 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224811d-74c8-44f9-bbbd-48324e4f8f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:28.052054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-a224811d-74c8-44f9-bbbd-48324e4f8f1e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:28.054050 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a224811d-74c8-44f9-bbbd-48324e4f8f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:28.192725 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 821/1660] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:28.218567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:28.220379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:28.355881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaa862-4791-474e-8a16-44be3c564fca admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:28.367670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1f7d4-18b2-46be-b25f-7606dcd57755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:28.369319 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1f7d4-18b2-46be-b25f-7606dcd57755 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:28.369553 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96443f22-2970-433e-b711-f1b499db6c03 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:28.369926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96443f22-2970-433e-b711-f1b499db6c03 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:28.370201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96443f22-2970-433e-b711-f1b499db6c03 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:28.370404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1f7d4-18b2-46be-b25f-7606dcd57755 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:28.370691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1f7d4-18b2-46be-b25f-7606dcd57755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:28.372093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 822/1661] 10.222.0.83 () {54 vars in 912 bytes} [Wed Dec 15 13:36:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:36:28.382509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75211e-8ec0-43d2-b6b0-ca1c356665a9 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:28.382711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75211e-8ec0-43d2-b6b0-ca1c356665a9 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:28.383068 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75211e-8ec0-43d2-b6b0-ca1c356665a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:28.395472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1f7d4-18b2-46be-b25f-7606dcd57755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:28.399340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1f7d4-18b2-46be-b25f-7606dcd57755 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:28.425432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 840/1662] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:28.464401 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-1f75211e-8ec0-43d2-b6b0-ca1c356665a9 None None] MFA Rules not processed for user `de1632f6a5414d2abfdee3b5bdd941cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:28.466306 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1f75211e-8ec0-43d2-b6b0-ca1c356665a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:28.488816 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 823/1663] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:36:28 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:28.511416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1f7d4-18b2-46be-b25f-7606dcd57755 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:28.512907 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f1e1f7d4-18b2-46be-b25f-7606dcd57755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:28.535327 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1f7d4-18b2-46be-b25f-7606dcd57755 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:28.542205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515d418-6351-431b-92b6-f090ae4a1463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:28.543129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515d418-6351-431b-92b6-f090ae4a1463 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:28.543579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515d418-6351-431b-92b6-f090ae4a1463 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:28.543857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515d418-6351-431b-92b6-f090ae4a1463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:28.592158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515d418-6351-431b-92b6-f090ae4a1463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:28.596595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515d418-6351-431b-92b6-f090ae4a1463 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:28.617644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 841/1664] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:30.231181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75211e-8ec0-43d2-b6b0-ca1c356665a9 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:30.232705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1f75211e-8ec0-43d2-b6b0-ca1c356665a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:30.300102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515d418-6351-431b-92b6-f090ae4a1463 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:30.302307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0515d418-6351-431b-92b6-f090ae4a1463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:30.343343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515d418-6351-431b-92b6-f090ae4a1463 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:30.357300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:30.377572 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:30.384605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:30.385200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] PATH_INFO: `/v3/projects/50ca8c7ca2f54cb5b0a25504cfc6d46e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:30.388271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ca8c7ca2f54cb5b0a25504cfc6d46e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:30.390349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: WARNING py.warnings [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:36:30.390349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: warnings.warn(msg) Dec 15 13:36:30.390349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: Dec 15 13:36:30.395291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:30.436146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75211e-8ec0-43d2-b6b0-ca1c356665a9 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:30.455439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff250f1c-fd50-4559-8697-9285872d5cc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b1d42ac3a427bb084740a069b577d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:30.456124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250f1c-fd50-4559-8697-9285872d5cc9 service placement] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:30.456399 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250f1c-fd50-4559-8697-9285872d5cc9 service placement] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:30.456674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250f1c-fd50-4559-8697-9285872d5cc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:30.464487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ff250f1c-fd50-4559-8697-9285872d5cc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:30.515842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff250f1c-fd50-4559-8697-9285872d5cc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:30.520067 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff250f1c-fd50-4559-8697-9285872d5cc9 service placement] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:30.527138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ca8c7ca2f54cb5b0a25504cfc6d46e', 'request_id': 'req-417ca9b3-5bc3-4228-b681-5a2b7babe39e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:30.544008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ca8c7ca2f54cb5b0a25504cfc6d46e', 'request_id': 'req-417ca9b3-5bc3-4228-b681-5a2b7babe39e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:30.557855 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ca8c7ca2f54cb5b0a25504cfc6d46e', 'request_id': 'req-417ca9b3-5bc3-4228-b681-5a2b7babe39e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:30.559418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 824/1665] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:30 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:30.579098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] The token cache is being invalidate because project 50ca8c7ca2f54cb5b0a25504cfc6d46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:30.579369 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:30.580092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-417ca9b3-5bc3-4228-b681-5a2b7babe39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:30.584642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 842/1666] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:30 2021] DELETE /identity/v3/projects/50ca8c7ca2f54cb5b0a25504cfc6d46e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:30.588296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff250f1c-fd50-4559-8697-9285872d5cc9 service placement] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:30.603567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff250f1c-fd50-4559-8697-9285872d5cc9 service placement] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:30.744076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cecc8d-bbb5-434b-9f8f-d995b202f653 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:30.744393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cecc8d-bbb5-434b-9f8f-d995b202f653 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:30.744668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cecc8d-bbb5-434b-9f8f-d995b202f653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:30.746488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:30.747967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:30.748475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:30.748963 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] PATH_INFO: `/v3/users/23aeed58917c47fdbfe6d0b2800e6374` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:30.750987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23aeed58917c47fdbfe6d0b2800e6374)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:30.752547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: WARNING py.warnings [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:36:30.752547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: warnings.warn(msg) Dec 15 13:36:30.752547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: Dec 15 13:36:30.754698 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:30.841194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-b8cecc8d-bbb5-434b-9f8f-d995b202f653 None None] MFA Rules not processed for user `7f7ab9d46c1842a7ae73dc1f43835d12`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:30.846043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b8cecc8d-bbb5-434b-9f8f-d995b202f653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:30.948559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23aeed58917c47fdbfe6d0b2800e6374'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:30.962494 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23aeed58917c47fdbfe6d0b2800e6374'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:30.984527 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23aeed58917c47fdbfe6d0b2800e6374'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:31.062239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23aeed58917c47fdbfe6d0b2800e6374'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:31.064858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-919e061f-2525-4c82-a79a-314feaa08804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23aeed58917c47fdbfe6d0b2800e6374'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:31.080977 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 825/1667] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:30 2021] DELETE /identity/v3/users/23aeed58917c47fdbfe6d0b2800e6374 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:31.097812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 843/1668] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:30 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:31.688927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b497c6-27e1-4f5b-bc4c-21c843bf655b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:31.690057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b497c6-27e1-4f5b-bc4c-21c843bf655b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:31.691091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b497c6-27e1-4f5b-bc4c-21c843bf655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:31.732584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-62b497c6-27e1-4f5b-bc4c-21c843bf655b None None] MFA Rules not processed for user `825dcf92d1b64c3d8a6c3e41cec2c836`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:31.734874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-62b497c6-27e1-4f5b-bc4c-21c843bf655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:31.875804 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 826/1669] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:31 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:31.896049 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cecc8d-bbb5-434b-9f8f-d995b202f653 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:31.899049 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b8cecc8d-bbb5-434b-9f8f-d995b202f653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:32.096725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cecc8d-bbb5-434b-9f8f-d995b202f653 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:32.265373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d757ae-0754-41f0-a414-a5803fe0fa96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:32.266719 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d757ae-0754-41f0-a414-a5803fe0fa96 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:32.268044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d757ae-0754-41f0-a414-a5803fe0fa96 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:32.268335 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d757ae-0754-41f0-a414-a5803fe0fa96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:32.283241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d757ae-0754-41f0-a414-a5803fe0fa96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:32.285062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d757ae-0754-41f0-a414-a5803fe0fa96 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:32.311192 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 844/1670] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:31 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:32.534718 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b497c6-27e1-4f5b-bc4c-21c843bf655b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:32.536463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-62b497c6-27e1-4f5b-bc4c-21c843bf655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:32.764235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b497c6-27e1-4f5b-bc4c-21c843bf655b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:32.777129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:32.778817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:32.779315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:32.782198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] PATH_INFO: `/v3/projects/749c0594f80f452da08f51d9a9173a1a` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:32.782198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=749c0594f80f452da08f51d9a9173a1a)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:32.784021 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:32.856113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749c0594f80f452da08f51d9a9173a1a', 'request_id': 'req-0c3b8c49-9d50-4153-ae35-8e6d913800f2'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:32.871660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749c0594f80f452da08f51d9a9173a1a', 'request_id': 'req-0c3b8c49-9d50-4153-ae35-8e6d913800f2'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:32.893322 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749c0594f80f452da08f51d9a9173a1a', 'request_id': 'req-0c3b8c49-9d50-4153-ae35-8e6d913800f2'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:32.909938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] The token cache is being invalidate because project 749c0594f80f452da08f51d9a9173a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:32.910914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:32.911766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0c3b8c49-9d50-4153-ae35-8e6d913800f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:32.913969 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 827/1671] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:32 2021] DELETE /identity/v3/projects/749c0594f80f452da08f51d9a9173a1a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:32.920306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82385c-5fd0-462f-91a5-d5c4525401ef None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:32.920805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82385c-5fd0-462f-91a5-d5c4525401ef None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:32.920905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82385c-5fd0-462f-91a5-d5c4525401ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:32.925432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553517e-d25b-443a-a093-897aeee3435e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:32.926700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553517e-d25b-443a-a093-897aeee3435e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:32.928506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553517e-d25b-443a-a093-897aeee3435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:32.971786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5f82385c-5fd0-462f-91a5-d5c4525401ef None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:32.973830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5f82385c-5fd0-462f-91a5-d5c4525401ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:33.000658 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b553517e-d25b-443a-a093-897aeee3435e None None] MFA Rules not processed for user `0a11e7a0c33b4df38bdb713cffe43911`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:33.006350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b553517e-d25b-443a-a093-897aeee3435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:33.115085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 828/1672] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:32 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:33.122037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d3bf3-572a-40b3-880a-66a1e093772b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:33.122331 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d3bf3-572a-40b3-880a-66a1e093772b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:33.122603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d3bf3-572a-40b3-880a-66a1e093772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:33.136309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 845/1673] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:33.181696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-dc8d3bf3-572a-40b3-880a-66a1e093772b None None] MFA Rules not processed for user `0a11e7a0c33b4df38bdb713cffe43911`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:33.183679 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-dc8d3bf3-572a-40b3-880a-66a1e093772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:33.204709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889580cc-6419-4812-b7d1-b3165d47932e None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:33.205199 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889580cc-6419-4812-b7d1-b3165d47932e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:33.205577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889580cc-6419-4812-b7d1-b3165d47932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:33.227067 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 829/1674] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:33 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:33.264462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-889580cc-6419-4812-b7d1-b3165d47932e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:33.266159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-889580cc-6419-4812-b7d1-b3165d47932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:33.289065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 846/1675] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:33.290398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d3bf3-572a-40b3-880a-66a1e093772b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:33.293511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-dc8d3bf3-572a-40b3-880a-66a1e093772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:33.299725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889580cc-6419-4812-b7d1-b3165d47932e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:33.327957 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889580cc-6419-4812-b7d1-b3165d47932e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:33.343920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0dbb4-ef30-4fe1-81ca-9d06147d42c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:33.344927 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0dbb4-ef30-4fe1-81ca-9d06147d42c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:33.345354 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0dbb4-ef30-4fe1-81ca-9d06147d42c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:33.345806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0dbb4-ef30-4fe1-81ca-9d06147d42c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:33.346886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0dbb4-ef30-4fe1-81ca-9d06147d42c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:33.348656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0dbb4-ef30-4fe1-81ca-9d06147d42c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:33.350560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0dbb4-ef30-4fe1-81ca-9d06147d42c6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:33.384996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 847/1676] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:33.390811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0dbb4-ef30-4fe1-81ca-9d06147d42c6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:33.413415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0dbb4-ef30-4fe1-81ca-9d06147d42c6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:33.425744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11e43e-4b51-4be8-9fb4-fa746573ad55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:33.428125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11e43e-4b51-4be8-9fb4-fa746573ad55 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:33.428403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11e43e-4b51-4be8-9fb4-fa746573ad55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:33.429247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11e43e-4b51-4be8-9fb4-fa746573ad55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:33.431057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11e43e-4b51-4be8-9fb4-fa746573ad55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:33.434531 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11e43e-4b51-4be8-9fb4-fa746573ad55 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:33.479883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d3bf3-572a-40b3-880a-66a1e093772b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:33.495556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20c512-4c05-4b60-9fdf-88b629cb4c4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:33.496395 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 848/1677] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:33 2021] POST /identity/v3/projects => generated 353 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:33.496724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20c512-4c05-4b60-9fdf-88b629cb4c4d service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:33.497010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20c512-4c05-4b60-9fdf-88b629cb4c4d service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:33.497343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20c512-4c05-4b60-9fdf-88b629cb4c4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:33.505674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11e43e-4b51-4be8-9fb4-fa746573ad55 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:33.555468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20c512-4c05-4b60-9fdf-88b629cb4c4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:33.557681 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20c512-4c05-4b60-9fdf-88b629cb4c4d service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:33.608759 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 830/1678] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:33 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:33.659402 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11e43e-4b51-4be8-9fb4-fa746573ad55 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:33.667206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab48927-cbce-4efa-8ac3-af4ea0d36ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:33.667909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab48927-cbce-4efa-8ac3-af4ea0d36ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:33.668189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab48927-cbce-4efa-8ac3-af4ea0d36ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:33.668461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab48927-cbce-4efa-8ac3-af4ea0d36ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:33.669250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab48927-cbce-4efa-8ac3-af4ea0d36ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:33.671583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab48927-cbce-4efa-8ac3-af4ea0d36ac4 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:33.737965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 849/1679] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:33 2021] POST /identity/v3/users => generated 277 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:33.742621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20c512-4c05-4b60-9fdf-88b629cb4c4d service nova] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:33.759238 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20c512-4c05-4b60-9fdf-88b629cb4c4d service nova] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:33.770685 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096688bf-0fb6-44ce-8136-56e4e56946bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:33.772479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096688bf-0fb6-44ce-8136-56e4e56946bd admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:33.773352 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096688bf-0fb6-44ce-8136-56e4e56946bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:33.774629 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096688bf-0fb6-44ce-8136-56e4e56946bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:33.775483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096688bf-0fb6-44ce-8136-56e4e56946bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:33.779788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096688bf-0fb6-44ce-8136-56e4e56946bd admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:33.809822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 831/1680] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:33 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:33.811379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab48927-cbce-4efa-8ac3-af4ea0d36ac4 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:33.830204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab48927-cbce-4efa-8ac3-af4ea0d36ac4 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:33.847683 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e90b76-1def-4617-990d-7637f1dfce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:33.848379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90b76-1def-4617-990d-7637f1dfce9f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:33.848667 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90b76-1def-4617-990d-7637f1dfce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:33.849797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90b76-1def-4617-990d-7637f1dfce9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:33.853308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e90b76-1def-4617-990d-7637f1dfce9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:33.854977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e90b76-1def-4617-990d-7637f1dfce9f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:33.883633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 850/1681] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:33 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:36:33.885048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096688bf-0fb6-44ce-8136-56e4e56946bd admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:33.900352 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096688bf-0fb6-44ce-8136-56e4e56946bd admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:33.919183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e15487-324b-4fa4-b152-c56166293f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:33.922153 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e15487-324b-4fa4-b152-c56166293f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:33.922673 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e15487-324b-4fa4-b152-c56166293f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:33.923223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e15487-324b-4fa4-b152-c56166293f99 admin admin] PATH_INFO: `/v3/projects/4b0a5cac8ab6434ca9d3fbe55f8062c4/users/c0ca499cbaf1459985708c88c54dfa8c/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:33.986280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e15487-324b-4fa4-b152-c56166293f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0a5cac8ab6434ca9d3fbe55f8062c4, user_id=c0ca499cbaf1459985708c88c54dfa8c, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:33.997436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e15487-324b-4fa4-b152-c56166293f99 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:34.046031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 832/1682] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:33 2021] PUT /identity/v3/projects/4b0a5cac8ab6434ca9d3fbe55f8062c4/users/c0ca499cbaf1459985708c88c54dfa8c/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:34.047140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dd49e-ead9-45d8-8f87-57e3e77d6c12 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:34.048004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dd49e-ead9-45d8-8f87-57e3e77d6c12 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:34.048458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dd49e-ead9-45d8-8f87-57e3e77d6c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:34.135907 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-fb7dd49e-ead9-45d8-8f87-57e3e77d6c12 None None] MFA Rules not processed for user `c0ca499cbaf1459985708c88c54dfa8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:34.139430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-fb7dd49e-ead9-45d8-8f87-57e3e77d6c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:34.352584 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 851/1683] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:34 2021] POST /identity/v3/auth/tokens => generated 3220 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:34.360395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e15487-324b-4fa4-b152-c56166293f99 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:34.416330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dd49e-ead9-45d8-8f87-57e3e77d6c12 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:34.419079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-fb7dd49e-ead9-45d8-8f87-57e3e77d6c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:34.512386 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e15487-324b-4fa4-b152-c56166293f99 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:34.531439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1e851-de4a-474c-b1f5-5204b34f3d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:34.535872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1e851-de4a-474c-b1f5-5204b34f3d92 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:34.544700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1e851-de4a-474c-b1f5-5204b34f3d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:34.546122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1e851-de4a-474c-b1f5-5204b34f3d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:34.546982 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1e851-de4a-474c-b1f5-5204b34f3d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:34.551704 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1e851-de4a-474c-b1f5-5204b34f3d92 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:34.597623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dd49e-ead9-45d8-8f87-57e3e77d6c12 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:34.618831 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 833/1684] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:34 2021] POST /identity/v3/projects => generated 357 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:34.624092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1e851-de4a-474c-b1f5-5204b34f3d92 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:34.624912 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:34.626978 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:34.628681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:34.629084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] PATH_INFO: `/v3/users/d18df8d5cf1c44efbefd2b7e008a33c4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:34.631577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18df8d5cf1c44efbefd2b7e008a33c4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:34.640314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:34.760051 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18df8d5cf1c44efbefd2b7e008a33c4'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:34.763444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1e851-de4a-474c-b1f5-5204b34f3d92 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:34.770052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe6e41-2e2f-4566-865d-21d1c5c6140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:34.770883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe6e41-2e2f-4566-865d-21d1c5c6140d admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:34.771428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe6e41-2e2f-4566-865d-21d1c5c6140d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:34.771517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe6e41-2e2f-4566-865d-21d1c5c6140d admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:34.773181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe6e41-2e2f-4566-865d-21d1c5c6140d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:34.775820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe6e41-2e2f-4566-865d-21d1c5c6140d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:34.794309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18df8d5cf1c44efbefd2b7e008a33c4'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:34.795580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18df8d5cf1c44efbefd2b7e008a33c4'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:34.819651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18df8d5cf1c44efbefd2b7e008a33c4'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:34.820852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18df8d5cf1c44efbefd2b7e008a33c4'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:34.823806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 834/1685] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:34 2021] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:34.828240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe6e41-2e2f-4566-865d-21d1c5c6140d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:34.834142 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-93fe6e41-2e2f-4566-865d-21d1c5c6140d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:34.844168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 852/1686] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:34 2021] DELETE /identity/v3/users/d18df8d5cf1c44efbefd2b7e008a33c4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:34.863622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe6e41-2e2f-4566-865d-21d1c5c6140d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:35.022332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217961ed-fe52-4996-b65f-a38a53b7388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:35.023689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217961ed-fe52-4996-b65f-a38a53b7388b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:35.023689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217961ed-fe52-4996-b65f-a38a53b7388b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:35.023689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217961ed-fe52-4996-b65f-a38a53b7388b admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:35.024845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217961ed-fe52-4996-b65f-a38a53b7388b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:35.027150 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217961ed-fe52-4996-b65f-a38a53b7388b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:35.048304 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 835/1687] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:34 2021] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:35.052413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:35.081359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a60dd2-8243-46dd-9728-23eaa01ae756 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:35.105654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c2de6-39ed-4753-ab4f-432c3cf54b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:35.107422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c2de6-39ed-4753-ab4f-432c3cf54b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:35.108494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c2de6-39ed-4753-ab4f-432c3cf54b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:35.110340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c2de6-39ed-4753-ab4f-432c3cf54b43 admin admin] PATH_INFO: `/v3/projects/9e8938407c7444b0acbafd9e9e306ef9/users/42f22d3f3ca448a8a0b0b54c6cd13b00/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:35.139846 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c2de6-39ed-4753-ab4f-432c3cf54b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8938407c7444b0acbafd9e9e306ef9, user_id=42f22d3f3ca448a8a0b0b54c6cd13b00, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:35.146315 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c2de6-39ed-4753-ab4f-432c3cf54b43 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:35.174408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 853/1688] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:35 2021] PUT /identity/v3/projects/9e8938407c7444b0acbafd9e9e306ef9/users/42f22d3f3ca448a8a0b0b54c6cd13b00/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:35.174999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217961ed-fe52-4996-b65f-a38a53b7388b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:35.186316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217961ed-fe52-4996-b65f-a38a53b7388b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:35.253711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fc57c-5609-47cf-a657-2b438920de22 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:35.254290 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fc57c-5609-47cf-a657-2b438920de22 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:35.254575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fc57c-5609-47cf-a657-2b438920de22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:35.314484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-226fc57c-5609-47cf-a657-2b438920de22 None None] MFA Rules not processed for user `0a11e7a0c33b4df38bdb713cffe43911`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:35.324403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-226fc57c-5609-47cf-a657-2b438920de22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:35.368690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19a9f4-dd23-423d-9841-35623afa0b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:35.371902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a9f4-dd23-423d-9841-35623afa0b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:35.372239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a9f4-dd23-423d-9841-35623afa0b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:35.372523 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a9f4-dd23-423d-9841-35623afa0b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:35.374298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a9f4-dd23-423d-9841-35623afa0b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:35.377711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a9f4-dd23-423d-9841-35623afa0b73 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:35.405920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 836/1689] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:35 2021] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:35.406900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19a9f4-dd23-423d-9841-35623afa0b73 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:35.410828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9b19a9f4-dd23-423d-9841-35623afa0b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:35.441701 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19a9f4-dd23-423d-9841-35623afa0b73 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:35.453848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:35.454732 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:35.459885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:35.460217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] PATH_INFO: `/v3/projects/a9e5c8d84d63416aa50961ac229d72b7` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:35.462437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e5c8d84d63416aa50961ac229d72b7)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:35.464964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:35.486435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 854/1690] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:35 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:35.487344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fc57c-5609-47cf-a657-2b438920de22 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:35.540731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fc57c-5609-47cf-a657-2b438920de22 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:35.562904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9efc8-62f6-4868-ae6c-bb3e1f7e2c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:35.563410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9efc8-62f6-4868-ae6c-bb3e1f7e2c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:35.571568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9efc8-62f6-4868-ae6c-bb3e1f7e2c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:35.572178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9efc8-62f6-4868-ae6c-bb3e1f7e2c3a admin admin] PATH_INFO: `/v3/projects/9e8938407c7444b0acbafd9e9e306ef9/users/42f22d3f3ca448a8a0b0b54c6cd13b00/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:35.584916 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9efc8-62f6-4868-ae6c-bb3e1f7e2c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8938407c7444b0acbafd9e9e306ef9, user_id=42f22d3f3ca448a8a0b0b54c6cd13b00, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:35.599010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9efc8-62f6-4868-ae6c-bb3e1f7e2c3a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:35.648404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e5c8d84d63416aa50961ac229d72b7', 'request_id': 'req-0902290f-80a8-487f-a1c1-a1c62a493bac'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:35.649260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 855/1691] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:35 2021] PUT /identity/v3/projects/9e8938407c7444b0acbafd9e9e306ef9/users/42f22d3f3ca448a8a0b0b54c6cd13b00/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:35.660620 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d999-6949-48f7-a0df-ceea04599128 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:35.666503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d999-6949-48f7-a0df-ceea04599128 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:35.668074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d999-6949-48f7-a0df-ceea04599128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:35.677246 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e5c8d84d63416aa50961ac229d72b7', 'request_id': 'req-0902290f-80a8-487f-a1c1-a1c62a493bac'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:35.701347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e5c8d84d63416aa50961ac229d72b7', 'request_id': 'req-0902290f-80a8-487f-a1c1-a1c62a493bac'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:35.727639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] The token cache is being invalidate because project a9e5c8d84d63416aa50961ac229d72b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:35.727639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:35.730120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:35.735041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 837/1692] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:35 2021] DELETE /identity/v3/projects/a9e5c8d84d63416aa50961ac229d72b7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:35.740598 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-41f4d999-6949-48f7-a0df-ceea04599128 None None] MFA Rules not processed for user `42f22d3f3ca448a8a0b0b54c6cd13b00`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:35.742705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-41f4d999-6949-48f7-a0df-ceea04599128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:35.750628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:35.753368 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:35.842905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 856/1693] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:35 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:35.854564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902290f-80a8-487f-a1c1-a1c62a493bac admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:35.858086 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d999-6949-48f7-a0df-ceea04599128 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:35.865322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-41f4d999-6949-48f7-a0df-ceea04599128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:35.938690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:35.939506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:35.941031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:35.941345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] PATH_INFO: `/v3/users/7f7ab9d46c1842a7ae73dc1f43835d12` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:35.943250 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7ab9d46c1842a7ae73dc1f43835d12)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:35.946520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:35.985550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d999-6949-48f7-a0df-ceea04599128 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:36.014297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480603f-d51d-4937-8909-ef150d2b2fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:36.015172 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480603f-d51d-4937-8909-ef150d2b2fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:36.015656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480603f-d51d-4937-8909-ef150d2b2fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:36.016119 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480603f-d51d-4937-8909-ef150d2b2fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:36.037535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480603f-d51d-4937-8909-ef150d2b2fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:36.043122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480603f-d51d-4937-8909-ef150d2b2fc2 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:36.062159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7ab9d46c1842a7ae73dc1f43835d12'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:36.078872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7ab9d46c1842a7ae73dc1f43835d12'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:36.098448 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7ab9d46c1842a7ae73dc1f43835d12'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:36.102941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 857/1694] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:35 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:36.148855 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7ab9d46c1842a7ae73dc1f43835d12'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:36.150181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7ab9d46c1842a7ae73dc1f43835d12'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:36.153508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da18166-58dc-4a39-920b-69108b5c1826 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:36.154176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da18166-58dc-4a39-920b-69108b5c1826 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:36.154929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da18166-58dc-4a39-920b-69108b5c1826 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:36.158592 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 858/1695] 10.222.0.83 () {54 vars in 912 bytes} [Wed Dec 15 13:36:36 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:36:36.159123 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 838/1696] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:35 2021] DELETE /identity/v3/users/7f7ab9d46c1842a7ae73dc1f43835d12 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:36.173679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ed9f3-2cf0-4f52-9f1f-d4fa9bd4ea03 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:36.176586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ed9f3-2cf0-4f52-9f1f-d4fa9bd4ea03 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:36.177155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ed9f3-2cf0-4f52-9f1f-d4fa9bd4ea03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:36.279442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:36.281243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:36.292582 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-868ed9f3-2cf0-4f52-9f1f-d4fa9bd4ea03 None None] MFA Rules not processed for user `de1632f6a5414d2abfdee3b5bdd941cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:36.295064 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-868ed9f3-2cf0-4f52-9f1f-d4fa9bd4ea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:36.646876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 859/1697] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:36:36 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:36.666328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4872011-e7ce-4ad1-9ecf-b5ef3538ab4f None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:36.677106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4872011-e7ce-4ad1-9ecf-b5ef3538ab4f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:36.677677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4872011-e7ce-4ad1-9ecf-b5ef3538ab4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:36.763292 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5272217-07a9-4d01-bd3a-441139e7411a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:36.783205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cb8f8-69e3-4bb4-9227-b2a80fd878d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:36.784325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb8f8-69e3-4bb4-9227-b2a80fd878d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:36.784800 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb8f8-69e3-4bb4-9227-b2a80fd878d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:36.785279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb8f8-69e3-4bb4-9227-b2a80fd878d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:36.803757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d89cb8f8-69e3-4bb4-9227-b2a80fd878d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:36.808024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-c4872011-e7ce-4ad1-9ecf-b5ef3538ab4f None None] MFA Rules not processed for user `825dcf92d1b64c3d8a6c3e41cec2c836`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:36.817518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c4872011-e7ce-4ad1-9ecf-b5ef3538ab4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:37.022110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cb8f8-69e3-4bb4-9227-b2a80fd878d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:37.025261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cb8f8-69e3-4bb4-9227-b2a80fd878d6 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:37.050898 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 839/1698] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:36 2021] GET /identity/v3/auth/tokens => generated 3220 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:37.053459 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cb8f8-69e3-4bb4-9227-b2a80fd878d6 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:37.058543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d89cb8f8-69e3-4bb4-9227-b2a80fd878d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:37.091964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cb8f8-69e3-4bb4-9227-b2a80fd878d6 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:37.113925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882b213-9ce3-4157-93af-141304b41298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:37.115747 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882b213-9ce3-4157-93af-141304b41298 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:37.117077 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882b213-9ce3-4157-93af-141304b41298 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:37.117384 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882b213-9ce3-4157-93af-141304b41298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:37.152254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 860/1699] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:36 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:37.160237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882b213-9ce3-4157-93af-141304b41298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:37.163807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4872011-e7ce-4ad1-9ecf-b5ef3538ab4f None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:37.167670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882b213-9ce3-4157-93af-141304b41298 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:37.168606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c4872011-e7ce-4ad1-9ecf-b5ef3538ab4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:37.200763 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 840/1700] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:37.230949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f760d37-49dc-4a8e-aa7d-cbba6715b4ba None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:37.231404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f760d37-49dc-4a8e-aa7d-cbba6715b4ba None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:37.231890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f760d37-49dc-4a8e-aa7d-cbba6715b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:37.270141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-7f760d37-49dc-4a8e-aa7d-cbba6715b4ba None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:37.272639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7f760d37-49dc-4a8e-aa7d-cbba6715b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:37.381372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4872011-e7ce-4ad1-9ecf-b5ef3538ab4f None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:37.399847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:37.403976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:37.405460 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:37.406542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] PATH_INFO: `/v3/projects/ca3a9bad323342759de5429e878212ce` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:37.411073 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3a9bad323342759de5429e878212ce)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:37.423457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:37.433458 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 841/1701] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:36:37 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:37.436715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f760d37-49dc-4a8e-aa7d-cbba6715b4ba None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:37.442984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7f760d37-49dc-4a8e-aa7d-cbba6715b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:37.488382 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f760d37-49dc-4a8e-aa7d-cbba6715b4ba None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:37.528881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:37.530372 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:37.530859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:37.531429 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] PATH_INFO: `/v3/users/1bc6685f480242af9008b984d63ecd4c` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:37.548936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc6685f480242af9008b984d63ecd4c)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:37.552818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:37.711155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3a9bad323342759de5429e878212ce', 'request_id': 'req-ab0711d6-9a04-4944-a4c4-f84f955d307d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:37.739221 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3a9bad323342759de5429e878212ce', 'request_id': 'req-ab0711d6-9a04-4944-a4c4-f84f955d307d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:37.760020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3a9bad323342759de5429e878212ce', 'request_id': 'req-ab0711d6-9a04-4944-a4c4-f84f955d307d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:37.776638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc6685f480242af9008b984d63ecd4c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:37.784017 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] The token cache is being invalidate because project ca3a9bad323342759de5429e878212ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:37.784311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:37.789921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ab0711d6-9a04-4944-a4c4-f84f955d307d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:37.803028 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 861/1702] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:37 2021] DELETE /identity/v3/projects/ca3a9bad323342759de5429e878212ce => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:37.807497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc6685f480242af9008b984d63ecd4c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:37.808978 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721ad7-7205-408e-a80c-708dd3f39b08 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:37.809356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721ad7-7205-408e-a80c-708dd3f39b08 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:37.809883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721ad7-7205-408e-a80c-708dd3f39b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:37.824514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc6685f480242af9008b984d63ecd4c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:37.843112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-39721ad7-7205-408e-a80c-708dd3f39b08 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:37.844715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-39721ad7-7205-408e-a80c-708dd3f39b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:37.850453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc6685f480242af9008b984d63ecd4c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:37.852008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc6685f480242af9008b984d63ecd4c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:37.864940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 842/1703] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:37 2021] DELETE /identity/v3/users/1bc6685f480242af9008b984d63ecd4c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:37.866796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:37.872608 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:37.950274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 862/1704] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:37.952414 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92b75-ea9d-4dba-9b7f-be5a12a0352f None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:37.952850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92b75-ea9d-4dba-9b7f-be5a12a0352f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:37.953259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92b75-ea9d-4dba-9b7f-be5a12a0352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:37.999359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5fe92b75-ea9d-4dba-9b7f-be5a12a0352f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:38.001061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5fe92b75-ea9d-4dba-9b7f-be5a12a0352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:38.015473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff223269-8b74-4668-b4fc-7b98f0c13ec8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:38.029317 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fcd39-8f4f-43d7-ae38-1d2cb0656e8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:38.030006 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fcd39-8f4f-43d7-ae38-1d2cb0656e8e service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:38.030299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fcd39-8f4f-43d7-ae38-1d2cb0656e8e service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:38.031130 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fcd39-8f4f-43d7-ae38-1d2cb0656e8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:38.033431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-886fcd39-8f4f-43d7-ae38-1d2cb0656e8e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:38.122382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 863/1705] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:38.135077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d783b1-88b6-4ba0-8150-108c51ae225c None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:38.137955 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d783b1-88b6-4ba0-8150-108c51ae225c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:38.138464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d783b1-88b6-4ba0-8150-108c51ae225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:38.139728 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fcd39-8f4f-43d7-ae38-1d2cb0656e8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:38.145799 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fcd39-8f4f-43d7-ae38-1d2cb0656e8e service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:38.162730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 843/1706] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:36:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:36:38.164259 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fcd39-8f4f-43d7-ae38-1d2cb0656e8e service swift] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:38.166802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-886fcd39-8f4f-43d7-ae38-1d2cb0656e8e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:38.181461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-45d783b1-88b6-4ba0-8150-108c51ae225c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:38.182738 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-45d783b1-88b6-4ba0-8150-108c51ae225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:38.193353 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 864/1707] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:38.199642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d783b1-88b6-4ba0-8150-108c51ae225c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:38.231405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d783b1-88b6-4ba0-8150-108c51ae225c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:38.244981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80690ddb-b25b-4d85-ab24-def69b7b16f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:38.246039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80690ddb-b25b-4d85-ab24-def69b7b16f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:38.246471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80690ddb-b25b-4d85-ab24-def69b7b16f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:38.246584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fcd39-8f4f-43d7-ae38-1d2cb0656e8e service swift] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:38.246975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80690ddb-b25b-4d85-ab24-def69b7b16f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:38.248088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80690ddb-b25b-4d85-ab24-def69b7b16f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:38.248585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80690ddb-b25b-4d85-ab24-def69b7b16f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:38.250349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80690ddb-b25b-4d85-ab24-def69b7b16f7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:38.255268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ece3b-cebd-47eb-a87d-1866b8457dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:38.255940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ece3b-cebd-47eb-a87d-1866b8457dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:38.256220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ece3b-cebd-47eb-a87d-1866b8457dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:38.256497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ece3b-cebd-47eb-a87d-1866b8457dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:38.282100 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 865/1708] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:38.286281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80690ddb-b25b-4d85-ab24-def69b7b16f7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:38.316136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80690ddb-b25b-4d85-ab24-def69b7b16f7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:38.318539 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ece3b-cebd-47eb-a87d-1866b8457dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:38.326735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ece3b-cebd-47eb-a87d-1866b8457dd3 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:38.346888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f69fe-ab21-401c-8a60-40e25430ed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:38.347932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f69fe-ab21-401c-8a60-40e25430ed36 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:38.348327 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f69fe-ab21-401c-8a60-40e25430ed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:38.348700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f69fe-ab21-401c-8a60-40e25430ed36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:38.349535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f69fe-ab21-401c-8a60-40e25430ed36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:38.352217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f69fe-ab21-401c-8a60-40e25430ed36 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:38.366742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 844/1709] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:38.465923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 866/1710] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:38 2021] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:38.467828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ece3b-cebd-47eb-a87d-1866b8457dd3 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:38.483496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ece3b-cebd-47eb-a87d-1866b8457dd3 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:38.713440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03005-4d77-428e-b892-e265d136834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:38.715385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03005-4d77-428e-b892-e265d136834a admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:38.718157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03005-4d77-428e-b892-e265d136834a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:38.718792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03005-4d77-428e-b892-e265d136834a admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:38.719699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c03005-4d77-428e-b892-e265d136834a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:38.724773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c03005-4d77-428e-b892-e265d136834a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:38.771577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 845/1711] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:38 2021] POST /identity/v3/users => generated 294 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:38.846511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f69fe-ab21-401c-8a60-40e25430ed36 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:38.874593 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f69fe-ab21-401c-8a60-40e25430ed36 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:38.885117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72204a1f-1511-4464-8266-d324cbe4e4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:38.886558 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72204a1f-1511-4464-8266-d324cbe4e4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:38.886850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72204a1f-1511-4464-8266-d324cbe4e4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:38.888969 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72204a1f-1511-4464-8266-d324cbe4e4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:38.891223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72204a1f-1511-4464-8266-d324cbe4e4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:38.896740 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72204a1f-1511-4464-8266-d324cbe4e4d1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:38.981585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 867/1712] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:38 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:38.982493 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03005-4d77-428e-b892-e265d136834a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:38.995453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03005-4d77-428e-b892-e265d136834a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:39.017145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac4feb-72cf-46ff-82ba-e1acda2e3bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:39.017881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac4feb-72cf-46ff-82ba-e1acda2e3bfd admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:39.018154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac4feb-72cf-46ff-82ba-e1acda2e3bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:39.018424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac4feb-72cf-46ff-82ba-e1acda2e3bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:39.019188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac4feb-72cf-46ff-82ba-e1acda2e3bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:39.020922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac4feb-72cf-46ff-82ba-e1acda2e3bfd admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:39.105225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72204a1f-1511-4464-8266-d324cbe4e4d1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:39.105982 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 846/1713] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:38 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:36:39.116264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72204a1f-1511-4464-8266-d324cbe4e4d1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:39.138255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dd32e-7cbc-491b-bbf7-f97012fcc9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:39.139228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dd32e-7cbc-491b-bbf7-f97012fcc9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:39.139563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dd32e-7cbc-491b-bbf7-f97012fcc9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:39.139841 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dd32e-7cbc-491b-bbf7-f97012fcc9b7 admin admin] PATH_INFO: `/v3/projects/da95a28fd5704a059185e278a7fd0281/users/f15dff77d18f4a5780f8ebbc1a6bbd80/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:39.209585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dd32e-7cbc-491b-bbf7-f97012fcc9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da95a28fd5704a059185e278a7fd0281, user_id=f15dff77d18f4a5780f8ebbc1a6bbd80, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:39.218666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dd32e-7cbc-491b-bbf7-f97012fcc9b7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:39.258331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 868/1714] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:39 2021] PUT /identity/v3/projects/da95a28fd5704a059185e278a7fd0281/users/f15dff77d18f4a5780f8ebbc1a6bbd80/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:39.268874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af83d2-63b5-4cb6-b432-676088a8e81d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:39.270062 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af83d2-63b5-4cb6-b432-676088a8e81d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:39.270285 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af83d2-63b5-4cb6-b432-676088a8e81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:39.338724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-67af83d2-63b5-4cb6-b432-676088a8e81d None None] MFA Rules not processed for user `f15dff77d18f4a5780f8ebbc1a6bbd80`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:39.341948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-67af83d2-63b5-4cb6-b432-676088a8e81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:39.414161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dd32e-7cbc-491b-bbf7-f97012fcc9b7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:39.416442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-451dd32e-7cbc-491b-bbf7-f97012fcc9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:39.592087 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 847/1715] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:39 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:39.596330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af83d2-63b5-4cb6-b432-676088a8e81d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:39.754333 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dd32e-7cbc-491b-bbf7-f97012fcc9b7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:39.778839 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:39.779759 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:39.780068 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:39.787111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] PATH_INFO: `/v3/projects/11b9bbd249ae4b4db4324b5f2223a374` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:39.788608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b9bbd249ae4b4db4324b5f2223a374)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:39.792175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:39.909961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af83d2-63b5-4cb6-b432-676088a8e81d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:39.933569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198decc-5b99-49f0-aa20-cccd01241c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:39.940169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198decc-5b99-49f0-aa20-cccd01241c44 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:39.940475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198decc-5b99-49f0-aa20-cccd01241c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:39.940759 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198decc-5b99-49f0-aa20-cccd01241c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:39.941494 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198decc-5b99-49f0-aa20-cccd01241c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:39.949531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198decc-5b99-49f0-aa20-cccd01241c44 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:39.980209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b9bbd249ae4b4db4324b5f2223a374', 'request_id': 'req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:40.010476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b9bbd249ae4b4db4324b5f2223a374', 'request_id': 'req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:40.019335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 848/1716] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:39 2021] POST /identity/v3/projects => generated 385 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:40.021283 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198decc-5b99-49f0-aa20-cccd01241c44 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:40.035727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b9bbd249ae4b4db4324b5f2223a374', 'request_id': 'req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:40.085665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] The token cache is being invalidate because project 11b9bbd249ae4b4db4324b5f2223a374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:40.088204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:40.090596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-31fa0969-d7bd-4c33-9e6b-6d19071b18eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:40.107667 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 869/1717] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:39 2021] DELETE /identity/v3/projects/11b9bbd249ae4b4db4324b5f2223a374 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:40.126643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba3f2b-106f-4e6d-887d-2ad8691201da None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:40.127014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba3f2b-106f-4e6d-887d-2ad8691201da None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:40.130065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba3f2b-106f-4e6d-887d-2ad8691201da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:40.183094 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198decc-5b99-49f0-aa20-cccd01241c44 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:40.190361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b0726-854a-4729-9506-56eb39c6acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:40.191597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b0726-854a-4729-9506-56eb39c6acc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:40.192058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b0726-854a-4729-9506-56eb39c6acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:40.192517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b0726-854a-4729-9506-56eb39c6acc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:40.194242 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b0726-854a-4729-9506-56eb39c6acc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:40.196497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b0726-854a-4729-9506-56eb39c6acc8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:40.243926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 849/1718] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:40 2021] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:40.245652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b0726-854a-4729-9506-56eb39c6acc8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:40.247773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-679b0726-854a-4729-9506-56eb39c6acc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:40.259488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-3cba3f2b-106f-4e6d-887d-2ad8691201da None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:40.262290 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b0726-854a-4729-9506-56eb39c6acc8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:40.265325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3cba3f2b-106f-4e6d-887d-2ad8691201da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:40.268062 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e164d06-17d1-474d-8378-1aaf28ee7d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:40.269032 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164d06-17d1-474d-8378-1aaf28ee7d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:40.269597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164d06-17d1-474d-8378-1aaf28ee7d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:40.270119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164d06-17d1-474d-8378-1aaf28ee7d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:40.272995 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164d06-17d1-474d-8378-1aaf28ee7d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:40.277008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164d06-17d1-474d-8378-1aaf28ee7d4f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:40.320299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 850/1719] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:40 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:40.320735 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 870/1720] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:40.323035 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba3f2b-106f-4e6d-887d-2ad8691201da None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:40.332539 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133acb16-2b1b-46db-9a40-d4a024725dda None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:40.333042 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133acb16-2b1b-46db-9a40-d4a024725dda None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:40.333530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133acb16-2b1b-46db-9a40-d4a024725dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:40.367881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba3f2b-106f-4e6d-887d-2ad8691201da None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:40.390707 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07da781-ca12-4695-ae2d-9d565c6a7d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:40.393036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07da781-ca12-4695-ae2d-9d565c6a7d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:40.393368 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07da781-ca12-4695-ae2d-9d565c6a7d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:40.394263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07da781-ca12-4695-ae2d-9d565c6a7d7c admin admin] PATH_INFO: `/v3/projects/20fea56c90d8478687b4cb032808cb2b/users/26bb232721e1418d8ca3fe02f7dcb72f/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:40.405437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-133acb16-2b1b-46db-9a40-d4a024725dda None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:40.410380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-133acb16-2b1b-46db-9a40-d4a024725dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:40.449569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07da781-ca12-4695-ae2d-9d565c6a7d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fea56c90d8478687b4cb032808cb2b, user_id=26bb232721e1418d8ca3fe02f7dcb72f, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:40.452336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 851/1721] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:40.456074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133acb16-2b1b-46db-9a40-d4a024725dda None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:40.456624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07da781-ca12-4695-ae2d-9d565c6a7d7c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:40.498686 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133acb16-2b1b-46db-9a40-d4a024725dda None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:40.501155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 871/1722] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:40 2021] PUT /identity/v3/projects/20fea56c90d8478687b4cb032808cb2b/users/26bb232721e1418d8ca3fe02f7dcb72f/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:40.505488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07da781-ca12-4695-ae2d-9d565c6a7d7c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:40.785537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07da781-ca12-4695-ae2d-9d565c6a7d7c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:40.792170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8d718-9bbc-4388-84c8-0849856d3d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:40.793099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8d718-9bbc-4388-84c8-0849856d3d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:40.793685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8d718-9bbc-4388-84c8-0849856d3d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:40.794365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8d718-9bbc-4388-84c8-0849856d3d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:40.795858 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8d718-9bbc-4388-84c8-0849856d3d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:40.799430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8d718-9bbc-4388-84c8-0849856d3d04 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:40.808179 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e2d49-23d7-4928-b297-16678b02a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:40.809599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2d49-23d7-4928-b297-16678b02a141 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:40.811463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2d49-23d7-4928-b297-16678b02a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:40.811988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2d49-23d7-4928-b297-16678b02a141 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:40.822165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 872/1723] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:40 2021] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:40.822165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8d718-9bbc-4388-84c8-0849856d3d04 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:40.825005 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e2d49-23d7-4928-b297-16678b02a141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:40.825791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e2d49-23d7-4928-b297-16678b02a141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:40.831248 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e2d49-23d7-4928-b297-16678b02a141 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:40.834550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8d718-9bbc-4388-84c8-0849856d3d04 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:40.841385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd125fe-8fad-47f9-a5bf-f5768aea1405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:40.842628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd125fe-8fad-47f9-a5bf-f5768aea1405 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:40.843134 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd125fe-8fad-47f9-a5bf-f5768aea1405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:40.843618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd125fe-8fad-47f9-a5bf-f5768aea1405 admin admin] PATH_INFO: `/v3/projects/20fea56c90d8478687b4cb032808cb2b/users/26bb232721e1418d8ca3fe02f7dcb72f/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:40.846692 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd125fe-8fad-47f9-a5bf-f5768aea1405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fea56c90d8478687b4cb032808cb2b, user_id=26bb232721e1418d8ca3fe02f7dcb72f, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:40.850817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd125fe-8fad-47f9-a5bf-f5768aea1405 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:40.865137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 873/1724] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:40 2021] PUT /identity/v3/projects/20fea56c90d8478687b4cb032808cb2b/users/26bb232721e1418d8ca3fe02f7dcb72f/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:40.879619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9fea7-e623-44d4-9e5c-990018cad237 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:40.881020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9fea7-e623-44d4-9e5c-990018cad237 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:40.882763 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9fea7-e623-44d4-9e5c-990018cad237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:40.914454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 852/1725] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:40.915554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e2d49-23d7-4928-b297-16678b02a141 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:40.947859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e2d49-23d7-4928-b297-16678b02a141 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:40.993033 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d6f9fea7-e623-44d4-9e5c-990018cad237 None None] MFA Rules not processed for user `26bb232721e1418d8ca3fe02f7dcb72f`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:40.994298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d6f9fea7-e623-44d4-9e5c-990018cad237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:41.188140 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ea43-7681-42c1-953c-4bf1b472898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:41.189508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ea43-7681-42c1-953c-4bf1b472898e admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:41.189837 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ea43-7681-42c1-953c-4bf1b472898e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:41.193001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ea43-7681-42c1-953c-4bf1b472898e admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:41.193967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50ea43-7681-42c1-953c-4bf1b472898e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:41.197210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50ea43-7681-42c1-953c-4bf1b472898e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:41.259024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 853/1726] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:40 2021] POST /identity/v3/projects => generated 365 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:41.260514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ea43-7681-42c1-953c-4bf1b472898e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:41.296883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 874/1727] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:40 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:41.322481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9fea7-e623-44d4-9e5c-990018cad237 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:41.324764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d6f9fea7-e623-44d4-9e5c-990018cad237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:41.531414 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ea43-7681-42c1-953c-4bf1b472898e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:41.547293 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe660002-778d-4ece-a22d-dbeab883efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:41.550754 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe660002-778d-4ece-a22d-dbeab883efa7 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:41.551079 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe660002-778d-4ece-a22d-dbeab883efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:41.551334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe660002-778d-4ece-a22d-dbeab883efa7 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:41.552064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe660002-778d-4ece-a22d-dbeab883efa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:41.558496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe660002-778d-4ece-a22d-dbeab883efa7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:41.580359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9fea7-e623-44d4-9e5c-990018cad237 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:41.656022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 854/1728] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:41 2021] POST /identity/v3/users => generated 283 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:41.659154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe660002-778d-4ece-a22d-dbeab883efa7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:41.732196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe660002-778d-4ece-a22d-dbeab883efa7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:41.752334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1bb28-6acd-4e7c-bcf7-99ed927fd05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:41.754273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1bb28-6acd-4e7c-bcf7-99ed927fd05d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:41.756449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1bb28-6acd-4e7c-bcf7-99ed927fd05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:41.758245 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1bb28-6acd-4e7c-bcf7-99ed927fd05d admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:41.760382 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1bb28-6acd-4e7c-bcf7-99ed927fd05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:41.770596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1bb28-6acd-4e7c-bcf7-99ed927fd05d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:41.806623 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 855/1729] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:41 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:41.809643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1bb28-6acd-4e7c-bcf7-99ed927fd05d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:41.820500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f678d1f-407b-42a1-a402-dd12f65b538c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:41.823414 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678d1f-407b-42a1-a402-dd12f65b538c service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:41.823761 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678d1f-407b-42a1-a402-dd12f65b538c service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:41.824578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678d1f-407b-42a1-a402-dd12f65b538c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:41.837663 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1bb28-6acd-4e7c-bcf7-99ed927fd05d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:41.858228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26024b9b-9b12-415d-bc9b-f5f9fd27a40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:41.859565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26024b9b-9b12-415d-bc9b-f5f9fd27a40c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:41.861138 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26024b9b-9b12-415d-bc9b-f5f9fd27a40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:41.861596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26024b9b-9b12-415d-bc9b-f5f9fd27a40c admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:41.864753 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26024b9b-9b12-415d-bc9b-f5f9fd27a40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:41.875983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26024b9b-9b12-415d-bc9b-f5f9fd27a40c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:41.922894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 856/1730] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:41 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:41.924906 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26024b9b-9b12-415d-bc9b-f5f9fd27a40c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:41.961310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26024b9b-9b12-415d-bc9b-f5f9fd27a40c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:41.996482 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085dd98-f503-4d5c-98c4-2f0013a163b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:41.998585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085dd98-f503-4d5c-98c4-2f0013a163b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:41.998864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085dd98-f503-4d5c-98c4-2f0013a163b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:42.000116 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085dd98-f503-4d5c-98c4-2f0013a163b8 admin admin] PATH_INFO: `/v3/projects/8822dcb03e674b79819d04d6d2748b45/users/700493f5e2cd46bebd0088c2c5283efa/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:42.045284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085dd98-f503-4d5c-98c4-2f0013a163b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8822dcb03e674b79819d04d6d2748b45, user_id=700493f5e2cd46bebd0088c2c5283efa, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:42.049997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085dd98-f503-4d5c-98c4-2f0013a163b8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:42.054994 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f678d1f-407b-42a1-a402-dd12f65b538c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:42.059111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f678d1f-407b-42a1-a402-dd12f65b538c service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:42.083362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 857/1731] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:41 2021] PUT /identity/v3/projects/8822dcb03e674b79819d04d6d2748b45/users/700493f5e2cd46bebd0088c2c5283efa/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:42.086933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 875/1732] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:41 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:42.121164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85331a0-2105-4b6b-96f3-ea6b335ea2d8 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:42.122848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85331a0-2105-4b6b-96f3-ea6b335ea2d8 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:42.123478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85331a0-2105-4b6b-96f3-ea6b335ea2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:42.147004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a660f-f0ed-4e46-be92-318e3125f43a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:42.147596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a660f-f0ed-4e46-be92-318e3125f43a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:42.148550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a660f-f0ed-4e46-be92-318e3125f43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:42.207029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d85331a0-2105-4b6b-96f3-ea6b335ea2d8 None None] MFA Rules not processed for user `de1632f6a5414d2abfdee3b5bdd941cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:42.212687 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d85331a0-2105-4b6b-96f3-ea6b335ea2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:42.234071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-bb5a660f-f0ed-4e46-be92-318e3125f43a None None] MFA Rules not processed for user `700493f5e2cd46bebd0088c2c5283efa`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:42.237798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bb5a660f-f0ed-4e46-be92-318e3125f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:42.385479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 858/1733] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Dec 15 13:36:42 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:42.386575 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85331a0-2105-4b6b-96f3-ea6b335ea2d8 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:42.388034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d85331a0-2105-4b6b-96f3-ea6b335ea2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:42.434033 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 876/1734] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:42 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:42.441722 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a660f-f0ed-4e46-be92-318e3125f43a None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:42.446015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bb5a660f-f0ed-4e46-be92-318e3125f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:42.481415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a660f-f0ed-4e46-be92-318e3125f43a None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:42.492245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525dcff-aeb1-41f2-b5ff-3f2ee1c5d8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:42.493288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525dcff-aeb1-41f2-b5ff-3f2ee1c5d8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:42.493569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525dcff-aeb1-41f2-b5ff-3f2ee1c5d8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:42.493996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525dcff-aeb1-41f2-b5ff-3f2ee1c5d8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:42.528146 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525dcff-aeb1-41f2-b5ff-3f2ee1c5d8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:42.529930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525dcff-aeb1-41f2-b5ff-3f2ee1c5d8e0 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:42.562908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 877/1735] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:42.563943 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525dcff-aeb1-41f2-b5ff-3f2ee1c5d8e0 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:42.567229 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5525dcff-aeb1-41f2-b5ff-3f2ee1c5d8e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:42.581320 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85331a0-2105-4b6b-96f3-ea6b335ea2d8 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:42.591548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c71aae-32ff-4748-99a2-9b90f8c34722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:42.592549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c71aae-32ff-4748-99a2-9b90f8c34722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:42.592826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c71aae-32ff-4748-99a2-9b90f8c34722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:42.593991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c71aae-32ff-4748-99a2-9b90f8c34722 admin admin] PATH_INFO: `/v3/users/8231d80b11064b848befd510c02d627a` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:42.595507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c71aae-32ff-4748-99a2-9b90f8c34722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8231d80b11064b848befd510c02d627a)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:42.597796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c71aae-32ff-4748-99a2-9b90f8c34722 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:42.710427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a6c71aae-32ff-4748-99a2-9b90f8c34722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8231d80b11064b848befd510c02d627a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:42.715527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525dcff-aeb1-41f2-b5ff-3f2ee1c5d8e0 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:42.723530 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcc131-faa4-4cde-bcc2-3cd24eb40959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:42.724230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcc131-faa4-4cde-bcc2-3cd24eb40959 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:42.724486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcc131-faa4-4cde-bcc2-3cd24eb40959 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:42.724761 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcc131-faa4-4cde-bcc2-3cd24eb40959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:42.725221 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a6c71aae-32ff-4748-99a2-9b90f8c34722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8231d80b11064b848befd510c02d627a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:42.738354 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a6c71aae-32ff-4748-99a2-9b90f8c34722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8231d80b11064b848befd510c02d627a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:42.754040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcc131-faa4-4cde-bcc2-3cd24eb40959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:42.755492 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcc131-faa4-4cde-bcc2-3cd24eb40959 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:42.757126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a6c71aae-32ff-4748-99a2-9b90f8c34722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8231d80b11064b848befd510c02d627a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:42.758877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a6c71aae-32ff-4748-99a2-9b90f8c34722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8231d80b11064b848befd510c02d627a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:42.768194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 878/1736] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:42 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:42.778846 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcc131-faa4-4cde-bcc2-3cd24eb40959 service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:42.782046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7edcc131-faa4-4cde-bcc2-3cd24eb40959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:42.795855 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 859/1737] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:42 2021] DELETE /identity/v3/users/8231d80b11064b848befd510c02d627a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:42.801541 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46920447-5790-4145-9a41-2a533d95f42a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:42.803094 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46920447-5790-4145-9a41-2a533d95f42a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:42.803390 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46920447-5790-4145-9a41-2a533d95f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:42.815929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcc131-faa4-4cde-bcc2-3cd24eb40959 service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:42.866085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-46920447-5790-4145-9a41-2a533d95f42a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:42.867878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-46920447-5790-4145-9a41-2a533d95f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:42.920367 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fd9eb-47ae-4677-b9e4-5acdc7e7b2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:42.921551 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fd9eb-47ae-4677-b9e4-5acdc7e7b2fd service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:42.922734 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fd9eb-47ae-4677-b9e4-5acdc7e7b2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:42.923393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fd9eb-47ae-4677-b9e4-5acdc7e7b2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:42.928376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-521fd9eb-47ae-4677-b9e4-5acdc7e7b2fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:42.951106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fd9eb-47ae-4677-b9e4-5acdc7e7b2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:42.952857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fd9eb-47ae-4677-b9e4-5acdc7e7b2fd service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:42.966383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 879/1738] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:43.175339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 860/1739] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:43.206856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fd9eb-47ae-4677-b9e4-5acdc7e7b2fd service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:43.208229 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-521fd9eb-47ae-4677-b9e4-5acdc7e7b2fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:43.254298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fd9eb-47ae-4677-b9e4-5acdc7e7b2fd service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:43.278320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd60b27-f1da-4157-8fbc-dd2c63d86f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:43.280971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd60b27-f1da-4157-8fbc-dd2c63d86f8a service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:43.281256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd60b27-f1da-4157-8fbc-dd2c63d86f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:43.288470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd60b27-f1da-4157-8fbc-dd2c63d86f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:43.352211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd60b27-f1da-4157-8fbc-dd2c63d86f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:43.358578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd60b27-f1da-4157-8fbc-dd2c63d86f8a service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:43.427811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 880/1740] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:44.303355 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46920447-5790-4145-9a41-2a533d95f42a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:44.305325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-46920447-5790-4145-9a41-2a533d95f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:44.320766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46920447-5790-4145-9a41-2a533d95f42a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:44.343219 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7b778-b014-4535-8598-8707737580e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:44.344537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7b778-b014-4535-8598-8707737580e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:44.344771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7b778-b014-4535-8598-8707737580e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:44.345047 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7b778-b014-4535-8598-8707737580e2 admin admin] PATH_INFO: `/v3/users/f15dff77d18f4a5780f8ebbc1a6bbd80` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:44.347520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7b778-b014-4535-8598-8707737580e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15dff77d18f4a5780f8ebbc1a6bbd80)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:44.353360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7b778-b014-4535-8598-8707737580e2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:44.455109 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-aad7b778-b014-4535-8598-8707737580e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15dff77d18f4a5780f8ebbc1a6bbd80'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:44.479395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-aad7b778-b014-4535-8598-8707737580e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15dff77d18f4a5780f8ebbc1a6bbd80'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:44.503829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-aad7b778-b014-4535-8598-8707737580e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15dff77d18f4a5780f8ebbc1a6bbd80'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:44.535175 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-aad7b778-b014-4535-8598-8707737580e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15dff77d18f4a5780f8ebbc1a6bbd80'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:44.537544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-aad7b778-b014-4535-8598-8707737580e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15dff77d18f4a5780f8ebbc1a6bbd80'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:44.557366 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 861/1741] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:44 2021] DELETE /identity/v3/users/f15dff77d18f4a5780f8ebbc1a6bbd80 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:44.559627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef023e-6762-432e-a805-7744506c4b9c None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:44.560123 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef023e-6762-432e-a805-7744506c4b9c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:44.560214 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef023e-6762-432e-a805-7744506c4b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:44.585569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-03ef023e-6762-432e-a805-7744506c4b9c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:44.587165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-03ef023e-6762-432e-a805-7744506c4b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:44.638653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d8f3f-649f-4f0b-9c22-3b549033657e None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:44.639788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d8f3f-649f-4f0b-9c22-3b549033657e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:44.640230 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d8f3f-649f-4f0b-9c22-3b549033657e None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:44.643168 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 862/1742] 10.222.0.83 () {54 vars in 921 bytes} [Wed Dec 15 13:36:44 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:36:44.693616 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff15ca-b813-4f85-92c8-9252a70128eb None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:44.694181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff15ca-b813-4f85-92c8-9252a70128eb None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:44.694670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff15ca-b813-4f85-92c8-9252a70128eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:44.725776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 881/1743] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:44.732754 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d4ff15ca-b813-4f85-92c8-9252a70128eb None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:44.738940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d4ff15ca-b813-4f85-92c8-9252a70128eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:44.740103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef023e-6762-432e-a805-7744506c4b9c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:44.744045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-03ef023e-6762-432e-a805-7744506c4b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:44.878717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef023e-6762-432e-a805-7744506c4b9c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:44.893265 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f173e79-3697-46c1-a96a-ddb2963fa16f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:44.893265 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f173e79-3697-46c1-a96a-ddb2963fa16f service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:44.893265 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f173e79-3697-46c1-a96a-ddb2963fa16f service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:44.893265 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f173e79-3697-46c1-a96a-ddb2963fa16f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:44.910959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f173e79-3697-46c1-a96a-ddb2963fa16f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:44.912280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f173e79-3697-46c1-a96a-ddb2963fa16f service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:44.936146 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 882/1744] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:44.963485 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 863/1745] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Dec 15 13:36:44 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:45.008633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f173e79-3697-46c1-a96a-ddb2963fa16f service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:45.010507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3f173e79-3697-46c1-a96a-ddb2963fa16f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:45.033175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f173e79-3697-46c1-a96a-ddb2963fa16f service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:45.045569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:45.046467 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:45.046748 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:45.047021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] PATH_INFO: `/v3/projects/d7e37b2e123847f08bbe4fb9d757013b` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:45.048255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e37b2e123847f08bbe4fb9d757013b)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:45.050208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:45.128608 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff15ca-b813-4f85-92c8-9252a70128eb None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:45.135936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d4ff15ca-b813-4f85-92c8-9252a70128eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:45.156657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e37b2e123847f08bbe4fb9d757013b', 'request_id': 'req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:45.164938 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e37b2e123847f08bbe4fb9d757013b', 'request_id': 'req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:45.176902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff15ca-b813-4f85-92c8-9252a70128eb None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:45.206764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e37b2e123847f08bbe4fb9d757013b', 'request_id': 'req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:45.265407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] The token cache is being invalidate because project d7e37b2e123847f08bbe4fb9d757013b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:45.265816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:45.268185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b4b7913b-d7b7-433e-b28e-3bab3a58dbba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:45.270433 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 883/1746] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:45 2021] DELETE /identity/v3/projects/d7e37b2e123847f08bbe4fb9d757013b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:45.276697 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59477faa-ebcb-4147-b4c7-8639e2fef12a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:45.277364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59477faa-ebcb-4147-b4c7-8639e2fef12a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:45.277701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59477faa-ebcb-4147-b4c7-8639e2fef12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:45.310249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-59477faa-ebcb-4147-b4c7-8639e2fef12a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:45.316098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-59477faa-ebcb-4147-b4c7-8639e2fef12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:45.380160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c6599-1f0a-4cf1-96bb-3f4698baccf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:45.381607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c6599-1f0a-4cf1-96bb-3f4698baccf9 service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:45.381847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c6599-1f0a-4cf1-96bb-3f4698baccf9 service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:45.382133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c6599-1f0a-4cf1-96bb-3f4698baccf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:45.390662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-224c6599-1f0a-4cf1-96bb-3f4698baccf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:45.422620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c6599-1f0a-4cf1-96bb-3f4698baccf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:45.424280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c6599-1f0a-4cf1-96bb-3f4698baccf9 service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:45.454206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 864/1747] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:45.515757 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 884/1748] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:45.525019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55ca04-7160-48db-af87-c36d401a3444 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:45.525305 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55ca04-7160-48db-af87-c36d401a3444 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:45.525577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55ca04-7160-48db-af87-c36d401a3444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:45.575010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-4c55ca04-7160-48db-af87-c36d401a3444 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:45.578803 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4c55ca04-7160-48db-af87-c36d401a3444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:45.611083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 865/1749] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:45.615753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59477faa-ebcb-4147-b4c7-8639e2fef12a None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:45.638834 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59477faa-ebcb-4147-b4c7-8639e2fef12a None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:45.658624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454907c-cd92-467b-8ac7-02a0939f4f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:45.659645 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454907c-cd92-467b-8ac7-02a0939f4f64 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:45.660124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454907c-cd92-467b-8ac7-02a0939f4f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:45.660553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454907c-cd92-467b-8ac7-02a0939f4f64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:45.661456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454907c-cd92-467b-8ac7-02a0939f4f64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:45.661938 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454907c-cd92-467b-8ac7-02a0939f4f64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:45.680654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454907c-cd92-467b-8ac7-02a0939f4f64 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:45.718158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 885/1750] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:45.719209 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55ca04-7160-48db-af87-c36d401a3444 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:45.729668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55ca04-7160-48db-af87-c36d401a3444 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:45.754517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ca0bc-709f-4f84-becb-f36f3435976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:45.755576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ca0bc-709f-4f84-becb-f36f3435976d admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:45.756197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ca0bc-709f-4f84-becb-f36f3435976d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:45.756706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ca0bc-709f-4f84-becb-f36f3435976d admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:45.758185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ca0bc-709f-4f84-becb-f36f3435976d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:45.763405 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ca0bc-709f-4f84-becb-f36f3435976d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:45.860174 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 866/1751] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:45 2021] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:45.860552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454907c-cd92-467b-8ac7-02a0939f4f64 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:45.884400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454907c-cd92-467b-8ac7-02a0939f4f64 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:46.057601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8334bed-abe4-47a3-8a55-5e2b24d8d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:46.058356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8334bed-abe4-47a3-8a55-5e2b24d8d2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:46.058651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8334bed-abe4-47a3-8a55-5e2b24d8d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:46.058920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8334bed-abe4-47a3-8a55-5e2b24d8d2c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:46.059640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8334bed-abe4-47a3-8a55-5e2b24d8d2c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:46.061892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8334bed-abe4-47a3-8a55-5e2b24d8d2c7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:46.128911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 886/1752] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:45 2021] POST /identity/v3/users => generated 288 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:46.132634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ca0bc-709f-4f84-becb-f36f3435976d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:46.183250 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ca0bc-709f-4f84-becb-f36f3435976d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:46.238958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dafc6-03ab-4fe4-ba87-ccd51ad4891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:46.239787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dafc6-03ab-4fe4-ba87-ccd51ad4891f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:46.240126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dafc6-03ab-4fe4-ba87-ccd51ad4891f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:46.240411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dafc6-03ab-4fe4-ba87-ccd51ad4891f admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:46.241397 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dafc6-03ab-4fe4-ba87-ccd51ad4891f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:46.243893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dafc6-03ab-4fe4-ba87-ccd51ad4891f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:46.259845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 867/1753] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:46 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:46.273162 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8334bed-abe4-47a3-8a55-5e2b24d8d2c7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:46.301607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8334bed-abe4-47a3-8a55-5e2b24d8d2c7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:46.321745 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07681a5-e3a3-4994-8700-4bf137e8094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:46.322384 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07681a5-e3a3-4994-8700-4bf137e8094d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:46.322930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07681a5-e3a3-4994-8700-4bf137e8094d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:46.323208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07681a5-e3a3-4994-8700-4bf137e8094d admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:46.323957 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07681a5-e3a3-4994-8700-4bf137e8094d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:46.325593 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07681a5-e3a3-4994-8700-4bf137e8094d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:46.358921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 887/1754] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:46 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:46.362813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dafc6-03ab-4fe4-ba87-ccd51ad4891f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:46.374935 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07681a5-e3a3-4994-8700-4bf137e8094d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:46.377074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e07681a5-e3a3-4994-8700-4bf137e8094d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:46.378254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dafc6-03ab-4fe4-ba87-ccd51ad4891f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:46.391297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87248d1-50f3-41c7-a6ad-5e0bcf60c1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:46.394353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87248d1-50f3-41c7-a6ad-5e0bcf60c1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:46.396125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87248d1-50f3-41c7-a6ad-5e0bcf60c1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:46.397231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87248d1-50f3-41c7-a6ad-5e0bcf60c1c2 admin admin] PATH_INFO: `/v3/projects/222e06a6162c4b199b848be04570de58/users/6985a1682981499b8a65b0ab50db3cd7/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:46.414667 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07681a5-e3a3-4994-8700-4bf137e8094d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:46.428711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:46.434597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:46.435000 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:46.435358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] PATH_INFO: `/v3/projects/da95a28fd5704a059185e278a7fd0281` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:46.437135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da95a28fd5704a059185e278a7fd0281)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:46.439581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:46.454857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87248d1-50f3-41c7-a6ad-5e0bcf60c1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222e06a6162c4b199b848be04570de58, user_id=6985a1682981499b8a65b0ab50db3cd7, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:46.459657 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87248d1-50f3-41c7-a6ad-5e0bcf60c1c2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:46.499020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 868/1755] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:46 2021] PUT /identity/v3/projects/222e06a6162c4b199b848be04570de58/users/6985a1682981499b8a65b0ab50db3cd7/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:46.560951 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e400e-521a-49ee-9a9f-b9cddc1e4d16 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:46.561393 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e400e-521a-49ee-9a9f-b9cddc1e4d16 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:46.562007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e400e-521a-49ee-9a9f-b9cddc1e4d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:46.598194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da95a28fd5704a059185e278a7fd0281', 'request_id': 'req-d91329b3-2e25-4c08-967a-799a5e7f5334'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:46.621091 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da95a28fd5704a059185e278a7fd0281', 'request_id': 'req-d91329b3-2e25-4c08-967a-799a5e7f5334'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:46.643005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da95a28fd5704a059185e278a7fd0281', 'request_id': 'req-d91329b3-2e25-4c08-967a-799a5e7f5334'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:46.648632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f84e400e-521a-49ee-9a9f-b9cddc1e4d16 None None] MFA Rules not processed for user `6985a1682981499b8a65b0ab50db3cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:46.662886 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f84e400e-521a-49ee-9a9f-b9cddc1e4d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:46.690632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] The token cache is being invalidate because project da95a28fd5704a059185e278a7fd0281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:46.719693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:46.722808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:46.728177 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 888/1756] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:46 2021] DELETE /identity/v3/projects/da95a28fd5704a059185e278a7fd0281 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:46.733898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:46.736624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:46.791013 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 869/1757] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:46 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:46.859084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91329b3-2e25-4c08-967a-799a5e7f5334 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:46.884429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26983af8-3334-463e-804c-692e8ccbd54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:46.888160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983af8-3334-463e-804c-692e8ccbd54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:46.888495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983af8-3334-463e-804c-692e8ccbd54b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:46.888733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983af8-3334-463e-804c-692e8ccbd54b admin admin] PATH_INFO: `/v3/users/26bb232721e1418d8ca3fe02f7dcb72f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:46.890213 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26983af8-3334-463e-804c-692e8ccbd54b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bb232721e1418d8ca3fe02f7dcb72f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:46.901547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26983af8-3334-463e-804c-692e8ccbd54b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:47.013701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-26983af8-3334-463e-804c-692e8ccbd54b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bb232721e1418d8ca3fe02f7dcb72f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:47.047946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-26983af8-3334-463e-804c-692e8ccbd54b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bb232721e1418d8ca3fe02f7dcb72f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:47.051296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-26983af8-3334-463e-804c-692e8ccbd54b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bb232721e1418d8ca3fe02f7dcb72f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:47.082160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-26983af8-3334-463e-804c-692e8ccbd54b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bb232721e1418d8ca3fe02f7dcb72f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:47.083267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-26983af8-3334-463e-804c-692e8ccbd54b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bb232721e1418d8ca3fe02f7dcb72f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:47.110704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 889/1758] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:46 2021] DELETE /identity/v3/users/26bb232721e1418d8ca3fe02f7dcb72f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:47.311914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e400e-521a-49ee-9a9f-b9cddc1e4d16 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:47.313726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f84e400e-521a-49ee-9a9f-b9cddc1e4d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:47.345132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0f0a6-a9fd-4d45-b138-622848f19879 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:47.345971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0f0a6-a9fd-4d45-b138-622848f19879 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:47.346531 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0f0a6-a9fd-4d45-b138-622848f19879 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:47.348823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 890/1759] 10.222.0.83 () {54 vars in 921 bytes} [Wed Dec 15 13:36:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:36:47.429071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e400e-521a-49ee-9a9f-b9cddc1e4d16 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:47.559540 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d320f-90ed-4f4d-a4f8-4e9497ad0dcf None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:47.559932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d320f-90ed-4f4d-a4f8-4e9497ad0dcf None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:47.560359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d320f-90ed-4f4d-a4f8-4e9497ad0dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:47.620159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-db0d320f-90ed-4f4d-a4f8-4e9497ad0dcf None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:47.635892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-db0d320f-90ed-4f4d-a4f8-4e9497ad0dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:47.639719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce3255-e438-4126-b28c-ccdb42e7504e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:47.642121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3255-e438-4126-b28c-ccdb42e7504e service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:47.643406 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3255-e438-4126-b28c-ccdb42e7504e service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:47.644380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3255-e438-4126-b28c-ccdb42e7504e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:47.649003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-51ce3255-e438-4126-b28c-ccdb42e7504e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:47.674221 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 891/1760] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Dec 15 13:36:47 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:47.706237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d320f-90ed-4f4d-a4f8-4e9497ad0dcf None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:47.707680 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-db0d320f-90ed-4f4d-a4f8-4e9497ad0dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:47.735984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d320f-90ed-4f4d-a4f8-4e9497ad0dcf None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:47.762277 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce3255-e438-4126-b28c-ccdb42e7504e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:47.764715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce3255-e438-4126-b28c-ccdb42e7504e service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:47.766090 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548cf82-4149-43bd-8340-060fc0d840ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:47.766808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548cf82-4149-43bd-8340-060fc0d840ec service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:47.767050 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548cf82-4149-43bd-8340-060fc0d840ec service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:47.767513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548cf82-4149-43bd-8340-060fc0d840ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:47.782256 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 870/1761] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:47 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:47.799464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548cf82-4149-43bd-8340-060fc0d840ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:47.801132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548cf82-4149-43bd-8340-060fc0d840ec service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:47.832132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 892/1762] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:47 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:48.314134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce3255-e438-4126-b28c-ccdb42e7504e service nova] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:48.315566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-51ce3255-e438-4126-b28c-ccdb42e7504e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:48.597272 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce3255-e438-4126-b28c-ccdb42e7504e service nova] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:48.610979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fe01c-9f43-469d-8f3f-88f654278613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:48.611954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fe01c-9f43-469d-8f3f-88f654278613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:48.612277 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fe01c-9f43-469d-8f3f-88f654278613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:48.612588 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fe01c-9f43-469d-8f3f-88f654278613 admin admin] PATH_INFO: `/v3/users/6985a1682981499b8a65b0ab50db3cd7` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:48.616444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fe01c-9f43-469d-8f3f-88f654278613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6985a1682981499b8a65b0ab50db3cd7)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:48.620044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fe01c-9f43-469d-8f3f-88f654278613 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:48.652549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548cf82-4149-43bd-8340-060fc0d840ec service nova] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:48.654618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9548cf82-4149-43bd-8340-060fc0d840ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:48.703479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548cf82-4149-43bd-8340-060fc0d840ec service nova] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:48.716691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:48.717976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:48.718455 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:48.718903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] PATH_INFO: `/v3/projects/20fea56c90d8478687b4cb032808cb2b` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:48.720480 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20fea56c90d8478687b4cb032808cb2b)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:48.722644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:48.770647 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-8b1fe01c-9f43-469d-8f3f-88f654278613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6985a1682981499b8a65b0ab50db3cd7'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:48.782617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-8b1fe01c-9f43-469d-8f3f-88f654278613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6985a1682981499b8a65b0ab50db3cd7'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:48.795014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-8b1fe01c-9f43-469d-8f3f-88f654278613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6985a1682981499b8a65b0ab50db3cd7'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:48.855973 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-8b1fe01c-9f43-469d-8f3f-88f654278613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6985a1682981499b8a65b0ab50db3cd7'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:48.857682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-8b1fe01c-9f43-469d-8f3f-88f654278613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6985a1682981499b8a65b0ab50db3cd7'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:48.867437 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20fea56c90d8478687b4cb032808cb2b', 'request_id': 'req-3f81a158-d64f-46f8-8440-e44922f2f5e2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:48.870520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 871/1763] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:48 2021] DELETE /identity/v3/users/6985a1682981499b8a65b0ab50db3cd7 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:48.876098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20fea56c90d8478687b4cb032808cb2b', 'request_id': 'req-3f81a158-d64f-46f8-8440-e44922f2f5e2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:48.878436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b76d0c-b3d3-4c33-82c3-b6faa6a06d8e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:48.879830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b76d0c-b3d3-4c33-82c3-b6faa6a06d8e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:48.880315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b76d0c-b3d3-4c33-82c3-b6faa6a06d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:48.892986 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20fea56c90d8478687b4cb032808cb2b', 'request_id': 'req-3f81a158-d64f-46f8-8440-e44922f2f5e2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:48.925414 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] The token cache is being invalidate because project 20fea56c90d8478687b4cb032808cb2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:48.926323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-54b76d0c-b3d3-4c33-82c3-b6faa6a06d8e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:48.928514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-54b76d0c-b3d3-4c33-82c3-b6faa6a06d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:48.936674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:48.938593 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f81a158-d64f-46f8-8440-e44922f2f5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:48.943438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 893/1764] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:48 2021] DELETE /identity/v3/projects/20fea56c90d8478687b4cb032808cb2b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:48.959057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34793d0c-80dd-4747-a3ff-428c1e1891b4 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:48.959500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34793d0c-80dd-4747-a3ff-428c1e1891b4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:48.959852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34793d0c-80dd-4747-a3ff-428c1e1891b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:49.029484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-34793d0c-80dd-4747-a3ff-428c1e1891b4 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:49.029484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-34793d0c-80dd-4747-a3ff-428c1e1891b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:49.087818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 872/1765] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:49.114430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b76d0c-b3d3-4c33-82c3-b6faa6a06d8e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:49.116461 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-54b76d0c-b3d3-4c33-82c3-b6faa6a06d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:49.234699 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 894/1766] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:49.249031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c70861-4b26-4d69-897a-caac91fd39d3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:49.249360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c70861-4b26-4d69-897a-caac91fd39d3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:49.250441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c70861-4b26-4d69-897a-caac91fd39d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:49.299186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-27c70861-4b26-4d69-897a-caac91fd39d3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:49.305478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-27c70861-4b26-4d69-897a-caac91fd39d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:49.317651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b76d0c-b3d3-4c33-82c3-b6faa6a06d8e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:49.325884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 895/1767] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:49.326958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c70861-4b26-4d69-897a-caac91fd39d3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:49.329843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ab31b-f827-47d1-adab-2ee2aa76b5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:49.330939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ab31b-f827-47d1-adab-2ee2aa76b5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:49.331434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ab31b-f827-47d1-adab-2ee2aa76b5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:49.331883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ab31b-f827-47d1-adab-2ee2aa76b5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:49.346011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c70861-4b26-4d69-897a-caac91fd39d3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:49.351337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ab31b-f827-47d1-adab-2ee2aa76b5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:49.356233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ab31b-f827-47d1-adab-2ee2aa76b5e5 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:49.363200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc7b36-d831-4599-91d4-780b17f35be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:49.364185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc7b36-d831-4599-91d4-780b17f35be5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:49.364678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc7b36-d831-4599-91d4-780b17f35be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:49.364948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc7b36-d831-4599-91d4-780b17f35be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:49.365922 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc7b36-d831-4599-91d4-780b17f35be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:49.366227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc7b36-d831-4599-91d4-780b17f35be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:49.369535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc7b36-d831-4599-91d4-780b17f35be5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:49.378428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 873/1768] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:49.387093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 896/1769] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:49.388268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ab31b-f827-47d1-adab-2ee2aa76b5e5 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:49.402436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ab31b-f827-47d1-adab-2ee2aa76b5e5 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:49.409870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6807528-36d0-482e-8a90-dec34c8dbf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:49.411500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6807528-36d0-482e-8a90-dec34c8dbf09 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:49.411864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6807528-36d0-482e-8a90-dec34c8dbf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:49.412349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6807528-36d0-482e-8a90-dec34c8dbf09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:49.413247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6807528-36d0-482e-8a90-dec34c8dbf09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:49.418274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6807528-36d0-482e-8a90-dec34c8dbf09 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:49.454292 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 874/1770] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:49 2021] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:49.460516 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc7b36-d831-4599-91d4-780b17f35be5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:49.482636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc7b36-d831-4599-91d4-780b17f35be5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:49.623353 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd8839-b3b9-42b2-a5f6-52dde11a4660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:49.626357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8839-b3b9-42b2-a5f6-52dde11a4660 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:49.626357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8839-b3b9-42b2-a5f6-52dde11a4660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:49.626797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8839-b3b9-42b2-a5f6-52dde11a4660 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:49.627546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd8839-b3b9-42b2-a5f6-52dde11a4660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:49.639983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd8839-b3b9-42b2-a5f6-52dde11a4660 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:49.735751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 897/1771] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:49 2021] POST /identity/v3/users => generated 286 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:49.744347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6807528-36d0-482e-8a90-dec34c8dbf09 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:49.779729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6807528-36d0-482e-8a90-dec34c8dbf09 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:49.792581 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46876cea-5f6d-4370-9492-d8d461a4f827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:49.805393 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46876cea-5f6d-4370-9492-d8d461a4f827 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:49.806092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46876cea-5f6d-4370-9492-d8d461a4f827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:49.808810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46876cea-5f6d-4370-9492-d8d461a4f827 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:49.810053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46876cea-5f6d-4370-9492-d8d461a4f827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:49.812768 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46876cea-5f6d-4370-9492-d8d461a4f827 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:49.834954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 875/1772] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:49 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:49.838633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd8839-b3b9-42b2-a5f6-52dde11a4660 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:49.866073 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd8839-b3b9-42b2-a5f6-52dde11a4660 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:49.877793 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdf0f3-3d98-4809-b06f-b76790ba8cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:49.899631 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdf0f3-3d98-4809-b06f-b76790ba8cce admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:49.900253 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdf0f3-3d98-4809-b06f-b76790ba8cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:49.901145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdf0f3-3d98-4809-b06f-b76790ba8cce admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:49.904568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdf0f3-3d98-4809-b06f-b76790ba8cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:49.916732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdf0f3-3d98-4809-b06f-b76790ba8cce admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:49.974020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46876cea-5f6d-4370-9492-d8d461a4f827 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:49.983068 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 898/1773] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:49 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:36:49.999517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46876cea-5f6d-4370-9492-d8d461a4f827 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:50.040905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a23462-121d-404d-a102-d2993e201e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:50.047723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a23462-121d-404d-a102-d2993e201e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:50.049857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a23462-121d-404d-a102-d2993e201e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:50.050200 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a23462-121d-404d-a102-d2993e201e41 admin admin] PATH_INFO: `/v3/projects/5e9c283712b1480181b57ffb2a3a1693/users/eae6a1e947d44f93b4302f85a091879e/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:50.108984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a23462-121d-404d-a102-d2993e201e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9c283712b1480181b57ffb2a3a1693, user_id=eae6a1e947d44f93b4302f85a091879e, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:50.118054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a23462-121d-404d-a102-d2993e201e41 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:50.165090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 876/1774] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:49 2021] PUT /identity/v3/projects/5e9c283712b1480181b57ffb2a3a1693/users/eae6a1e947d44f93b4302f85a091879e/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:50.170637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1d50-9846-4a96-8f5b-d64de4199a20 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:50.170945 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1d50-9846-4a96-8f5b-d64de4199a20 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:50.171244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1d50-9846-4a96-8f5b-d64de4199a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:50.206710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a71a1d50-9846-4a96-8f5b-d64de4199a20 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:50.208189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a71a1d50-9846-4a96-8f5b-d64de4199a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:50.402449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 899/1775] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:50.413970 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a23462-121d-404d-a102-d2993e201e41 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:50.421734 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-17a23462-121d-404d-a102-d2993e201e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:50.458164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a23462-121d-404d-a102-d2993e201e41 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:50.463725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a1d50-9846-4a96-8f5b-d64de4199a20 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:50.467158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:50.468164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:50.468626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:50.468757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] PATH_INFO: `/v3/projects/222e06a6162c4b199b848be04570de58` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:50.473699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] RBAC: Authorizing `identity:delete_project(project_id=222e06a6162c4b199b848be04570de58)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:50.475792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:50.607359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a1d50-9846-4a96-8f5b-d64de4199a20 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:50.615967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222e06a6162c4b199b848be04570de58', 'request_id': 'req-ce8f1145-4bf7-42d9-bb69-7e88c210380e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:50.645435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222e06a6162c4b199b848be04570de58', 'request_id': 'req-ce8f1145-4bf7-42d9-bb69-7e88c210380e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:50.667935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222e06a6162c4b199b848be04570de58', 'request_id': 'req-ce8f1145-4bf7-42d9-bb69-7e88c210380e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:50.690058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] The token cache is being invalidate because project 222e06a6162c4b199b848be04570de58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:50.690506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:50.692872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ce8f1145-4bf7-42d9-bb69-7e88c210380e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:50.695299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 877/1776] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:50 2021] DELETE /identity/v3/projects/222e06a6162c4b199b848be04570de58 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:50.707122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2e2e5-ffab-49ac-b3e2-cbf30d462d54 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:50.707439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2e2e5-ffab-49ac-b3e2-cbf30d462d54 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:50.707655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2e2e5-ffab-49ac-b3e2-cbf30d462d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:50.735711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72517c0-ce6c-48d5-9812-c82885b12e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:50.736626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72517c0-ce6c-48d5-9812-c82885b12e0d service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:50.737203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72517c0-ce6c-48d5-9812-c82885b12e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:50.737203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72517c0-ce6c-48d5-9812-c82885b12e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:50.739443 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c72517c0-ce6c-48d5-9812-c82885b12e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:50.760179 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-5db2e2e5-ffab-49ac-b3e2-cbf30d462d54 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:50.761659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-5db2e2e5-ffab-49ac-b3e2-cbf30d462d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:50.941728 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 878/1777] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:50.953910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8cd15-2a22-458a-9113-9909c8b28bc1 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:50.954314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8cd15-2a22-458a-9113-9909c8b28bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:50.956333 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8cd15-2a22-458a-9113-9909c8b28bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:50.972674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72517c0-ce6c-48d5-9812-c82885b12e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:50.972674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72517c0-ce6c-48d5-9812-c82885b12e0d service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:51.005247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 900/1778] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:36:51.047552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-86a8cd15-2a22-458a-9113-9909c8b28bc1 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:51.048802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-86a8cd15-2a22-458a-9113-9909c8b28bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:51.087893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 879/1779] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:51.089075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72517c0-ce6c-48d5-9812-c82885b12e0d service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:51.114114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72517c0-ce6c-48d5-9812-c82885b12e0d service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:51.153276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337947c2-6698-4381-8615-fc4ab3fcc51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:51.164335 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337947c2-6698-4381-8615-fc4ab3fcc51c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:51.164634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337947c2-6698-4381-8615-fc4ab3fcc51c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:51.164929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337947c2-6698-4381-8615-fc4ab3fcc51c admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:51.167748 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337947c2-6698-4381-8615-fc4ab3fcc51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:51.173168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337947c2-6698-4381-8615-fc4ab3fcc51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:51.177051 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337947c2-6698-4381-8615-fc4ab3fcc51c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:51.239697 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 901/1780] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:51.246757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8cd15-2a22-458a-9113-9909c8b28bc1 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:51.263885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8cd15-2a22-458a-9113-9909c8b28bc1 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:51.276277 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2342fc1-dc65-4723-9dae-b796560bdfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:51.278916 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2342fc1-dc65-4723-9dae-b796560bdfdb admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:51.280576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2342fc1-dc65-4723-9dae-b796560bdfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:51.281100 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2342fc1-dc65-4723-9dae-b796560bdfdb admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:51.284061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2342fc1-dc65-4723-9dae-b796560bdfdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:51.287900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2342fc1-dc65-4723-9dae-b796560bdfdb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:51.378547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 880/1781] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:51 2021] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:51.381281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337947c2-6698-4381-8615-fc4ab3fcc51c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:51.402177 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337947c2-6698-4381-8615-fc4ab3fcc51c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:51.502881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d0239-44f9-4064-8b90-c92c44efe27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:51.503724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d0239-44f9-4064-8b90-c92c44efe27a admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:51.504011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d0239-44f9-4064-8b90-c92c44efe27a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:51.504356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d0239-44f9-4064-8b90-c92c44efe27a admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:51.506060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d0239-44f9-4064-8b90-c92c44efe27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:51.509660 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d0239-44f9-4064-8b90-c92c44efe27a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:51.542513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 902/1782] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:51 2021] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:51.546747 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2342fc1-dc65-4723-9dae-b796560bdfdb admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:51.562000 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2342fc1-dc65-4723-9dae-b796560bdfdb admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:51.568053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf016-150c-485c-8855-ea59330071e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:51.568852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf016-150c-485c-8855-ea59330071e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:51.569198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf016-150c-485c-8855-ea59330071e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:51.569524 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf016-150c-485c-8855-ea59330071e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:51.570523 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cf016-150c-485c-8855-ea59330071e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:51.572444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cf016-150c-485c-8855-ea59330071e2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:51.587497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 881/1783] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:51 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:51.592948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d0239-44f9-4064-8b90-c92c44efe27a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:51.605887 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d0239-44f9-4064-8b90-c92c44efe27a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:51.614306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d5897-1093-47c7-9d1d-016ec5682e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:51.615260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5897-1093-47c7-9d1d-016ec5682e02 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:51.615693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5897-1093-47c7-9d1d-016ec5682e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:51.616065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5897-1093-47c7-9d1d-016ec5682e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:51.617434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d5897-1093-47c7-9d1d-016ec5682e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:51.619208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d5897-1093-47c7-9d1d-016ec5682e02 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:51.636791 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 903/1784] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:51 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:51.641387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf016-150c-485c-8855-ea59330071e2 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:51.664818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf016-150c-485c-8855-ea59330071e2 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:51.671931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308f41-e0c3-4a25-b5b3-3ba059240354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:51.674716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308f41-e0c3-4a25-b5b3-3ba059240354 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:51.675216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308f41-e0c3-4a25-b5b3-3ba059240354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:51.675659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308f41-e0c3-4a25-b5b3-3ba059240354 admin admin] PATH_INFO: `/v3/projects/eb68416ba25142ac8a0145bb0ad8e5a1/users/395690f930f242b99b4127852f3ee1db/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:51.695752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2308f41-e0c3-4a25-b5b3-3ba059240354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb68416ba25142ac8a0145bb0ad8e5a1, user_id=395690f930f242b99b4127852f3ee1db, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:51.702151 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2308f41-e0c3-4a25-b5b3-3ba059240354 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:51.733458 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 882/1785] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:51 2021] PUT /identity/v3/projects/eb68416ba25142ac8a0145bb0ad8e5a1/users/395690f930f242b99b4127852f3ee1db/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:51.744504 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b858856-19fa-41c7-93ef-c61d060f38f8 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:51.745044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b858856-19fa-41c7-93ef-c61d060f38f8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:51.745236 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b858856-19fa-41c7-93ef-c61d060f38f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:51.785262 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8b858856-19fa-41c7-93ef-c61d060f38f8 None None] MFA Rules not processed for user `395690f930f242b99b4127852f3ee1db`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:51.786848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8b858856-19fa-41c7-93ef-c61d060f38f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:51.888656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 904/1786] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:51 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:51.893895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308f41-e0c3-4a25-b5b3-3ba059240354 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:51.983792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308f41-e0c3-4a25-b5b3-3ba059240354 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:51.990168 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12166f22-4a11-4726-83cb-c048e6615295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:51.991134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12166f22-4a11-4726-83cb-c048e6615295 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:51.991515 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12166f22-4a11-4726-83cb-c048e6615295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:51.991946 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12166f22-4a11-4726-83cb-c048e6615295 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:51.993714 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12166f22-4a11-4726-83cb-c048e6615295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:51.995942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12166f22-4a11-4726-83cb-c048e6615295 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:52.035918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 883/1787] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:51 2021] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:52.041662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b858856-19fa-41c7-93ef-c61d060f38f8 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:52.063648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b858856-19fa-41c7-93ef-c61d060f38f8 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:52.148816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7fe20-e875-4bb7-bdb5-5da1e444f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:52.149533 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7fe20-e875-4bb7-bdb5-5da1e444f84c admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:52.149830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7fe20-e875-4bb7-bdb5-5da1e444f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:52.150163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7fe20-e875-4bb7-bdb5-5da1e444f84c admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:52.150865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7fe20-e875-4bb7-bdb5-5da1e444f84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:52.153110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7fe20-e875-4bb7-bdb5-5da1e444f84c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:52.182174 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 905/1788] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:52 2021] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:52.191183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12166f22-4a11-4726-83cb-c048e6615295 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:52.218054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12166f22-4a11-4726-83cb-c048e6615295 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:52.226983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515b936-c62a-49f2-b7a7-261878f83eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:52.228204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515b936-c62a-49f2-b7a7-261878f83eab admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:52.228700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515b936-c62a-49f2-b7a7-261878f83eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:52.229168 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515b936-c62a-49f2-b7a7-261878f83eab admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:52.230816 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515b936-c62a-49f2-b7a7-261878f83eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:52.234012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515b936-c62a-49f2-b7a7-261878f83eab admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:52.249688 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 884/1789] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:52 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:52.255504 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7fe20-e875-4bb7-bdb5-5da1e444f84c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:52.275270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7fe20-e875-4bb7-bdb5-5da1e444f84c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:52.281646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8584b53-5d02-47f4-890c-d01a91268b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:52.282518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8584b53-5d02-47f4-890c-d01a91268b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:52.282934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8584b53-5d02-47f4-890c-d01a91268b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:52.283306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8584b53-5d02-47f4-890c-d01a91268b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:52.284154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8584b53-5d02-47f4-890c-d01a91268b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:52.286685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8584b53-5d02-47f4-890c-d01a91268b1f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:52.307561 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 906/1790] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:52 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:52.311674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515b936-c62a-49f2-b7a7-261878f83eab admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:52.334878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515b936-c62a-49f2-b7a7-261878f83eab admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:52.345240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dff81-1902-461e-9a62-ec44ef30540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:52.346422 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dff81-1902-461e-9a62-ec44ef30540c admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:52.346821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dff81-1902-461e-9a62-ec44ef30540c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:52.347233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dff81-1902-461e-9a62-ec44ef30540c admin admin] PATH_INFO: `/v3/projects/677ee0c8e5684ebfbaed3c4b1e12a33e/users/2093e1202d2343b1b8e11cc5aad30263/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:52.368666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dff81-1902-461e-9a62-ec44ef30540c admin admin] RBAC: Authorizing `identity:create_grant(project_id=677ee0c8e5684ebfbaed3c4b1e12a33e, user_id=2093e1202d2343b1b8e11cc5aad30263, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:52.370904 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dff81-1902-461e-9a62-ec44ef30540c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:52.393184 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 885/1791] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:52 2021] PUT /identity/v3/projects/677ee0c8e5684ebfbaed3c4b1e12a33e/users/2093e1202d2343b1b8e11cc5aad30263/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:52.404443 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac094-58fd-4288-be9d-4fe83f844d01 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:52.405159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac094-58fd-4288-be9d-4fe83f844d01 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:52.405691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac094-58fd-4288-be9d-4fe83f844d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:52.479849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-dd3ac094-58fd-4288-be9d-4fe83f844d01 None None] MFA Rules not processed for user `2093e1202d2343b1b8e11cc5aad30263`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:52.485191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-dd3ac094-58fd-4288-be9d-4fe83f844d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:52.670709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 907/1792] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:52 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:52.675470 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dff81-1902-461e-9a62-ec44ef30540c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:52.758409 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dff81-1902-461e-9a62-ec44ef30540c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:52.763910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04706015-3d71-47df-84c5-9636a1927d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:52.764798 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04706015-3d71-47df-84c5-9636a1927d79 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:52.765074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04706015-3d71-47df-84c5-9636a1927d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:52.765338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04706015-3d71-47df-84c5-9636a1927d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:52.766310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04706015-3d71-47df-84c5-9636a1927d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:52.768457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04706015-3d71-47df-84c5-9636a1927d79 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:52.805924 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 886/1793] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:52 2021] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:52.812087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ac094-58fd-4288-be9d-4fe83f844d01 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:52.823931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ac094-58fd-4288-be9d-4fe83f844d01 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:52.906016 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40607c-0595-4b1e-835c-8efdb148a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:52.906832 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40607c-0595-4b1e-835c-8efdb148a8eb admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:52.907197 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40607c-0595-4b1e-835c-8efdb148a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:52.907546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40607c-0595-4b1e-835c-8efdb148a8eb admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:52.908348 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40607c-0595-4b1e-835c-8efdb148a8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:52.910899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40607c-0595-4b1e-835c-8efdb148a8eb admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:52.937004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 908/1794] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:52 2021] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:52.941457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04706015-3d71-47df-84c5-9636a1927d79 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:52.959884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04706015-3d71-47df-84c5-9636a1927d79 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:52.967158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0f7ec-9c6a-4019-b405-aaa7a8219506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:52.967840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f7ec-9c6a-4019-b405-aaa7a8219506 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:52.968120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f7ec-9c6a-4019-b405-aaa7a8219506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:52.968391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f7ec-9c6a-4019-b405-aaa7a8219506 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:52.969126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0f7ec-9c6a-4019-b405-aaa7a8219506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:52.970897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0f7ec-9c6a-4019-b405-aaa7a8219506 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:52.987232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 887/1795] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:52 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:52.991566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40607c-0595-4b1e-835c-8efdb148a8eb admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:53.005625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40607c-0595-4b1e-835c-8efdb148a8eb admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:53.010965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcb376-c8a2-499b-8050-97290eacac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:53.011856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcb376-c8a2-499b-8050-97290eacac5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:53.012145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcb376-c8a2-499b-8050-97290eacac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:53.012421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcb376-c8a2-499b-8050-97290eacac5f admin admin] PATH_INFO: `/v3/projects/e678e94c8d47418d94b52cb6be54e3f1/users/2da2ffdc4b444c1b857697ac93fc9980/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:53.049305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcb376-c8a2-499b-8050-97290eacac5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e678e94c8d47418d94b52cb6be54e3f1, user_id=2da2ffdc4b444c1b857697ac93fc9980, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:53.052717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcb376-c8a2-499b-8050-97290eacac5f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:53.073789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 909/1796] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:52 2021] PUT /identity/v3/projects/e678e94c8d47418d94b52cb6be54e3f1/users/2da2ffdc4b444c1b857697ac93fc9980/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:53.077975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0f7ec-9c6a-4019-b405-aaa7a8219506 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:53.090285 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0f7ec-9c6a-4019-b405-aaa7a8219506 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:53.152990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96fdcf-87c5-44ab-83e9-43f31cf2870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:53.153634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96fdcf-87c5-44ab-83e9-43f31cf2870a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:53.154273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96fdcf-87c5-44ab-83e9-43f31cf2870a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:53.154273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96fdcf-87c5-44ab-83e9-43f31cf2870a admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:53.155229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96fdcf-87c5-44ab-83e9-43f31cf2870a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:53.157373 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96fdcf-87c5-44ab-83e9-43f31cf2870a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:53.181810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 888/1797] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:53 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:53.185220 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcb376-c8a2-499b-8050-97290eacac5f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:53.198279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcb376-c8a2-499b-8050-97290eacac5f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:53.203889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c87d3-efbe-488b-92fe-577f70830b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:53.204790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c87d3-efbe-488b-92fe-577f70830b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:53.205123 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c87d3-efbe-488b-92fe-577f70830b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:53.205867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c87d3-efbe-488b-92fe-577f70830b07 admin admin] PATH_INFO: `/v3/projects/e678e94c8d47418d94b52cb6be54e3f1/users/2da2ffdc4b444c1b857697ac93fc9980/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:53.207947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c87d3-efbe-488b-92fe-577f70830b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e678e94c8d47418d94b52cb6be54e3f1, user_id=2da2ffdc4b444c1b857697ac93fc9980, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:53.212554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c87d3-efbe-488b-92fe-577f70830b07 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:53.245851 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 910/1798] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:53 2021] PUT /identity/v3/projects/e678e94c8d47418d94b52cb6be54e3f1/users/2da2ffdc4b444c1b857697ac93fc9980/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:53.248140 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8009cf-c1d1-49bb-92b2-7968669e2204 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:53.248558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8009cf-c1d1-49bb-92b2-7968669e2204 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:53.248843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8009cf-c1d1-49bb-92b2-7968669e2204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:53.283728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aa168-4104-4497-8cd4-855e0c232d32 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:53.284101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aa168-4104-4497-8cd4-855e0c232d32 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:53.284386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aa168-4104-4497-8cd4-855e0c232d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:53.293303 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-fe8009cf-c1d1-49bb-92b2-7968669e2204 None None] MFA Rules not processed for user `2da2ffdc4b444c1b857697ac93fc9980`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:53.294617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fe8009cf-c1d1-49bb-92b2-7968669e2204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:53.317715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-323aa168-4104-4497-8cd4-855e0c232d32 None None] MFA Rules not processed for user `eae6a1e947d44f93b4302f85a091879e`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:53.318545 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-323aa168-4104-4497-8cd4-855e0c232d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:53.455750 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 911/1799] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:53 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:53.456715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aa168-4104-4497-8cd4-855e0c232d32 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:53.459263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-323aa168-4104-4497-8cd4-855e0c232d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:53.464104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 889/1800] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:53 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:53.475888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8009cf-c1d1-49bb-92b2-7968669e2204 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:53.478196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fe8009cf-c1d1-49bb-92b2-7968669e2204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:53.567411 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aa168-4104-4497-8cd4-855e0c232d32 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:53.580591 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a42027-ee87-455b-a9b4-974ce1a3c37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:53.581275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a42027-ee87-455b-a9b4-974ce1a3c37a admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:53.581551 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a42027-ee87-455b-a9b4-974ce1a3c37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:53.581854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a42027-ee87-455b-a9b4-974ce1a3c37a admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:53.582564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a42027-ee87-455b-a9b4-974ce1a3c37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:53.585443 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a42027-ee87-455b-a9b4-974ce1a3c37a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:53.608786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8009cf-c1d1-49bb-92b2-7968669e2204 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:53.624553 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51037a82-0f37-4a5a-97c3-202cd9c7bc54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:53.626170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51037a82-0f37-4a5a-97c3-202cd9c7bc54 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:53.627773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51037a82-0f37-4a5a-97c3-202cd9c7bc54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:53.629589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51037a82-0f37-4a5a-97c3-202cd9c7bc54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:53.648422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 912/1801] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:53 2021] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:53.656963 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51037a82-0f37-4a5a-97c3-202cd9c7bc54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:53.658311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a42027-ee87-455b-a9b4-974ce1a3c37a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:53.660154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51037a82-0f37-4a5a-97c3-202cd9c7bc54 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:53.672850 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 890/1802] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:53 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:36:53.827550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a42027-ee87-455b-a9b4-974ce1a3c37a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:53.844778 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af070b-eb02-423a-9910-c51640527599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:53.845874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af070b-eb02-423a-9910-c51640527599 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:53.846154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af070b-eb02-423a-9910-c51640527599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:53.847071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af070b-eb02-423a-9910-c51640527599 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:53.847996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af070b-eb02-423a-9910-c51640527599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:53.852154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af070b-eb02-423a-9910-c51640527599 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:53.897816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 913/1803] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:53 2021] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:53.900422 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51037a82-0f37-4a5a-97c3-202cd9c7bc54 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:53.915653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51037a82-0f37-4a5a-97c3-202cd9c7bc54 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:53.945095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3df50d-5016-4a42-9e4b-031aec7aadff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:53.947124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3df50d-5016-4a42-9e4b-031aec7aadff admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:53.947560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3df50d-5016-4a42-9e4b-031aec7aadff admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:53.948237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3df50d-5016-4a42-9e4b-031aec7aadff admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:53.948993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3df50d-5016-4a42-9e4b-031aec7aadff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:53.950651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3df50d-5016-4a42-9e4b-031aec7aadff admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:53.978742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af070b-eb02-423a-9910-c51640527599 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:53.980107 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 891/1804] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:53 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:53.993160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af070b-eb02-423a-9910-c51640527599 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:54.001893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23194d91-09bf-4770-877a-8519c62e323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:54.002796 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23194d91-09bf-4770-877a-8519c62e323a admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:54.003356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23194d91-09bf-4770-877a-8519c62e323a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:54.003703 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23194d91-09bf-4770-877a-8519c62e323a admin admin] PATH_INFO: `/v3/projects/fd8153c577f94375934abe6bf43c6776/users/094f936d1bd74cfcbca189fd36fef9c2/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:54.038010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23194d91-09bf-4770-877a-8519c62e323a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8153c577f94375934abe6bf43c6776, user_id=094f936d1bd74cfcbca189fd36fef9c2, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:54.040912 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23194d91-09bf-4770-877a-8519c62e323a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:54.073930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 914/1805] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:53 2021] PUT /identity/v3/projects/fd8153c577f94375934abe6bf43c6776/users/094f936d1bd74cfcbca189fd36fef9c2/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:54.076655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3df50d-5016-4a42-9e4b-031aec7aadff admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:54.089161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3df50d-5016-4a42-9e4b-031aec7aadff admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:54.193404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7b8ed-c5ae-4ab4-9af6-1e2d9554aa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:54.194661 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7b8ed-c5ae-4ab4-9af6-1e2d9554aa51 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:54.195661 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7b8ed-c5ae-4ab4-9af6-1e2d9554aa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:54.196529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7b8ed-c5ae-4ab4-9af6-1e2d9554aa51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:54.198443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7b8ed-c5ae-4ab4-9af6-1e2d9554aa51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:54.200787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7b8ed-c5ae-4ab4-9af6-1e2d9554aa51 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:54.218108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 892/1806] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:54 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:54.221287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23194d91-09bf-4770-877a-8519c62e323a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:54.244366 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23194d91-09bf-4770-877a-8519c62e323a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:54.254008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d47bc-49c3-48db-9923-bf07353c3a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:54.255210 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d47bc-49c3-48db-9923-bf07353c3a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:54.255651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d47bc-49c3-48db-9923-bf07353c3a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:54.256165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d47bc-49c3-48db-9923-bf07353c3a8f admin admin] PATH_INFO: `/v3/projects/fd8153c577f94375934abe6bf43c6776/users/094f936d1bd74cfcbca189fd36fef9c2/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:54.259108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d47bc-49c3-48db-9923-bf07353c3a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8153c577f94375934abe6bf43c6776, user_id=094f936d1bd74cfcbca189fd36fef9c2, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:54.262206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d47bc-49c3-48db-9923-bf07353c3a8f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:54.275964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 915/1807] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:54 2021] PUT /identity/v3/projects/fd8153c577f94375934abe6bf43c6776/users/094f936d1bd74cfcbca189fd36fef9c2/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:55.011799 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7b8ed-c5ae-4ab4-9af6-1e2d9554aa51 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:55.015208 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c2f7b8ed-c5ae-4ab4-9af6-1e2d9554aa51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:55.090074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7b8ed-c5ae-4ab4-9af6-1e2d9554aa51 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:55.143873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d1ad1-1155-417e-a4e8-fc5c97ce08f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:55.144525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1ad1-1155-417e-a4e8-fc5c97ce08f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:55.144810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1ad1-1155-417e-a4e8-fc5c97ce08f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:55.145632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1ad1-1155-417e-a4e8-fc5c97ce08f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:55.201642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d1ad1-1155-417e-a4e8-fc5c97ce08f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:55.203229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d1ad1-1155-417e-a4e8-fc5c97ce08f5 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:55.212704 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 893/1808] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:55 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:55.438488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7656c-a4ba-430f-91dd-05b98ef2b158 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:55.438995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7656c-a4ba-430f-91dd-05b98ef2b158 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:55.439223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7656c-a4ba-430f-91dd-05b98ef2b158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:55.464068 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d1ad1-1155-417e-a4e8-fc5c97ce08f5 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:55.465467 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fb9d1ad1-1155-417e-a4e8-fc5c97ce08f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:55.487482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-eab7656c-a4ba-430f-91dd-05b98ef2b158 None None] MFA Rules not processed for user `094f936d1bd74cfcbca189fd36fef9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:55.487721 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-eab7656c-a4ba-430f-91dd-05b98ef2b158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:55.610522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d1ad1-1155-417e-a4e8-fc5c97ce08f5 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:55.618412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:55.619937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:55.620422 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:55.620847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] PATH_INFO: `/v3/users/700493f5e2cd46bebd0088c2c5283efa` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:55.622632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=700493f5e2cd46bebd0088c2c5283efa)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:55.624752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:55.626759 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 916/1809] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:55 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:55.637995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7656c-a4ba-430f-91dd-05b98ef2b158 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:55.647599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7656c-a4ba-430f-91dd-05b98ef2b158 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:55.657182 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb319210-0c36-4f25-a54c-2ce158b251d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:55.657983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb319210-0c36-4f25-a54c-2ce158b251d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:55.658271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb319210-0c36-4f25-a54c-2ce158b251d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:55.658550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb319210-0c36-4f25-a54c-2ce158b251d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:55.698686 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '700493f5e2cd46bebd0088c2c5283efa'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:55.706008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '700493f5e2cd46bebd0088c2c5283efa'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:55.716044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '700493f5e2cd46bebd0088c2c5283efa'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:55.724568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb319210-0c36-4f25-a54c-2ce158b251d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:55.726041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb319210-0c36-4f25-a54c-2ce158b251d4 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:55.733437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '700493f5e2cd46bebd0088c2c5283efa'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:55.735905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '700493f5e2cd46bebd0088c2c5283efa'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:55.736393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 917/1810] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:55 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:36:55.742117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 894/1811] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:55 2021] DELETE /identity/v3/users/700493f5e2cd46bebd0088c2c5283efa => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:55.746788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff7f8-4e5e-4a3b-8e38-a2da9e9455e7 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:55.747146 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff7f8-4e5e-4a3b-8e38-a2da9e9455e7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:55.747526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff7f8-4e5e-4a3b-8e38-a2da9e9455e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:55.767013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-ed4ff7f8-4e5e-4a3b-8e38-a2da9e9455e7 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:55.768107 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ed4ff7f8-4e5e-4a3b-8e38-a2da9e9455e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:55.851433 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 918/1812] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:55.861249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:55.864482 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:55.931824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5bf9-4066-43c4-89fa-7ae5c9c3a218 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:55.935630 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a6662-35e3-4e7b-a344-fad526a3ce65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:55.936282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a6662-35e3-4e7b-a344-fad526a3ce65 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:55.936572 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a6662-35e3-4e7b-a344-fad526a3ce65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:55.936842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a6662-35e3-4e7b-a344-fad526a3ce65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:55.947454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a6662-35e3-4e7b-a344-fad526a3ce65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:55.949159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a6662-35e3-4e7b-a344-fad526a3ce65 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:55.961579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 895/1813] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:36:56.153129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff7f8-4e5e-4a3b-8e38-a2da9e9455e7 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:56.154582 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ed4ff7f8-4e5e-4a3b-8e38-a2da9e9455e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.166713 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff7f8-4e5e-4a3b-8e38-a2da9e9455e7 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.171987 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.172865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.173137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.173407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] PATH_INFO: `/v3/users/c0ca499cbaf1459985708c88c54dfa8c` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.174684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ca499cbaf1459985708c88c54dfa8c)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.176588 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:56.233790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ca499cbaf1459985708c88c54dfa8c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.241076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ca499cbaf1459985708c88c54dfa8c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.242945 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ca499cbaf1459985708c88c54dfa8c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.260063 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ca499cbaf1459985708c88c54dfa8c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.261215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ca499cbaf1459985708c88c54dfa8c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.276677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 919/1814] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:56 2021] DELETE /identity/v3/users/c0ca499cbaf1459985708c88c54dfa8c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:56.285716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b88580-e97e-4f83-b153-0dcfab012426 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.285716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b88580-e97e-4f83-b153-0dcfab012426 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.285716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b88580-e97e-4f83-b153-0dcfab012426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.286464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:56.286464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.316604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e1b88580-e97e-4f83-b153-0dcfab012426 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:56.318040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e1b88580-e97e-4f83-b153-0dcfab012426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.371094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba126-168b-4704-8373-d99df459cc43 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.383135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.384302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.384592 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.384847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] PATH_INFO: `/v3/projects/8822dcb03e674b79819d04d6d2748b45` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.387716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8822dcb03e674b79819d04d6d2748b45)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.389856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:56.397500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 896/1815] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:56.412021 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b88580-e97e-4f83-b153-0dcfab012426 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:56.414197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e1b88580-e97e-4f83-b153-0dcfab012426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.448630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8822dcb03e674b79819d04d6d2748b45', 'request_id': 'req-52ef60d6-93af-47f4-9c8b-15f81027f91e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.457303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8822dcb03e674b79819d04d6d2748b45', 'request_id': 'req-52ef60d6-93af-47f4-9c8b-15f81027f91e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.466405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8822dcb03e674b79819d04d6d2748b45', 'request_id': 'req-52ef60d6-93af-47f4-9c8b-15f81027f91e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.481421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] The token cache is being invalidate because project 8822dcb03e674b79819d04d6d2748b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:56.481632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.482274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52ef60d6-93af-47f4-9c8b-15f81027f91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:56.486712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 920/1816] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:56 2021] DELETE /identity/v3/projects/8822dcb03e674b79819d04d6d2748b45 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:56.491429 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b88580-e97e-4f83-b153-0dcfab012426 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.492926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf0aa4-fef7-46f8-ba15-cf7089530ed8 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.493220 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf0aa4-fef7-46f8-ba15-cf7089530ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.493496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf0aa4-fef7-46f8-ba15-cf7089530ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.512987 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-b3bf0aa4-fef7-46f8-ba15-cf7089530ed8 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:56.514244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b3bf0aa4-fef7-46f8-ba15-cf7089530ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.556624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b8f7e-99f9-49ed-b5c5-bcd723e9d94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.557510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b8f7e-99f9-49ed-b5c5-bcd723e9d94f service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.557812 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b8f7e-99f9-49ed-b5c5-bcd723e9d94f service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.558090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b8f7e-99f9-49ed-b5c5-bcd723e9d94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.559900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7c0b8f7e-99f9-49ed-b5c5-bcd723e9d94f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.586168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 921/1817] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:56.595535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6528c1a-231c-40df-b6c0-ec431a49b908 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.595880 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6528c1a-231c-40df-b6c0-ec431a49b908 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.596218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6528c1a-231c-40df-b6c0-ec431a49b908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.636554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e6528c1a-231c-40df-b6c0-ec431a49b908 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:56.638660 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e6528c1a-231c-40df-b6c0-ec431a49b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:56.649798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 922/1818] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:56.653511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6528c1a-231c-40df-b6c0-ec431a49b908 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:56.659758 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b8f7e-99f9-49ed-b5c5-bcd723e9d94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.661560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b8f7e-99f9-49ed-b5c5-bcd723e9d94f service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:56.668033 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6528c1a-231c-40df-b6c0-ec431a49b908 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.677247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7166e-03c4-490e-891a-fbda7db46fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.680447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 897/1819] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:36:56.681194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7166e-03c4-490e-891a-fbda7db46fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.681548 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7166e-03c4-490e-891a-fbda7db46fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.682061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7166e-03c4-490e-891a-fbda7db46fa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.683270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7166e-03c4-490e-891a-fbda7db46fa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:56.683651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7166e-03c4-490e-891a-fbda7db46fa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.685405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7166e-03c4-490e-891a-fbda7db46fa6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:56.699936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 923/1820] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:36:56.709146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b8f7e-99f9-49ed-b5c5-bcd723e9d94f service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:56.719053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b8f7e-99f9-49ed-b5c5-bcd723e9d94f service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.724967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a6fe5-1579-46dc-bb67-f96fb631cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.725891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6fe5-1579-46dc-bb67-f96fb631cb93 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.726666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6fe5-1579-46dc-bb67-f96fb631cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.726939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6fe5-1579-46dc-bb67-f96fb631cb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.727648 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a6fe5-1579-46dc-bb67-f96fb631cb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.729552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a6fe5-1579-46dc-bb67-f96fb631cb93 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:56.763898 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 898/1821] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:56 2021] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:56.771522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7166e-03c4-490e-891a-fbda7db46fa6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:56.782694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7166e-03c4-490e-891a-fbda7db46fa6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.892907 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51811b-6948-4132-902e-a6780f1104e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.894060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51811b-6948-4132-902e-a6780f1104e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.894463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51811b-6948-4132-902e-a6780f1104e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.894746 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51811b-6948-4132-902e-a6780f1104e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.896093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51811b-6948-4132-902e-a6780f1104e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.899257 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51811b-6948-4132-902e-a6780f1104e4 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:56.932078 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 924/1822] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:56 2021] POST /identity/v3/users => generated 302 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:56.936182 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a6fe5-1579-46dc-bb67-f96fb631cb93 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:56.947375 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a6fe5-1579-46dc-bb67-f96fb631cb93 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.953636 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1e0a4-f566-4fb0-8d69-3740b3c79ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.954154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1e0a4-f566-4fb0-8d69-3740b3c79ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.954434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1e0a4-f566-4fb0-8d69-3740b3c79ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.955308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1e0a4-f566-4fb0-8d69-3740b3c79ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.955433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1e0a4-f566-4fb0-8d69-3740b3c79ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.957053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1e0a4-f566-4fb0-8d69-3740b3c79ea3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:56.969978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 899/1823] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:56 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:36:56.975472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51811b-6948-4132-902e-a6780f1104e4 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:56.986190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51811b-6948-4132-902e-a6780f1104e4 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:56.991302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8d3c5-c848-49fa-8a32-b8333064e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:56.991717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8d3c5-c848-49fa-8a32-b8333064e8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:56.992532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8d3c5-c848-49fa-8a32-b8333064e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:56.992809 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8d3c5-c848-49fa-8a32-b8333064e8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:56.993565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8d3c5-c848-49fa-8a32-b8333064e8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:56.995300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8d3c5-c848-49fa-8a32-b8333064e8f1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.015746 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 925/1824] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:56 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:36:57.016943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1e0a4-f566-4fb0-8d69-3740b3c79ea3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.022101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8d3c5-c848-49fa-8a32-b8333064e8f1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.024368 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0ae8d3c5-c848-49fa-8a32-b8333064e8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.036328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1e0a4-f566-4fb0-8d69-3740b3c79ea3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.042509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8d3c5-c848-49fa-8a32-b8333064e8f1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.043207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de774b-1139-4f40-a5b5-f97a50dc5a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.045856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de774b-1139-4f40-a5b5-f97a50dc5a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.045856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de774b-1139-4f40-a5b5-f97a50dc5a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.045856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de774b-1139-4f40-a5b5-f97a50dc5a21 admin admin] PATH_INFO: `/v3/projects/452064599a594e7f85e8db263c4b417c/users/1bfe7dcf64a74ff18eff30985c912e48/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.049275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.050264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.050909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.050909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] PATH_INFO: `/v3/projects/4b0a5cac8ab6434ca9d3fbe55f8062c4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.052297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0a5cac8ab6434ca9d3fbe55f8062c4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.055599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.133176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0a5cac8ab6434ca9d3fbe55f8062c4', 'request_id': 'req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.141587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0a5cac8ab6434ca9d3fbe55f8062c4', 'request_id': 'req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.152193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0a5cac8ab6434ca9d3fbe55f8062c4', 'request_id': 'req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.163501 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] The token cache is being invalidate because project 4b0a5cac8ab6434ca9d3fbe55f8062c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:57.163852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.164533 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.166320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 926/1825] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:57 2021] DELETE /identity/v3/projects/4b0a5cac8ab6434ca9d3fbe55f8062c4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:57.170336 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.171752 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.190922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de774b-1139-4f40-a5b5-f97a50dc5a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=452064599a594e7f85e8db263c4b417c, user_id=1bfe7dcf64a74ff18eff30985c912e48, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.193557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de774b-1139-4f40-a5b5-f97a50dc5a21 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.208246 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 900/1826] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:57 2021] PUT /identity/v3/projects/452064599a594e7f85e8db263c4b417c/users/1bfe7dcf64a74ff18eff30985c912e48/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:57.218269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0662b-976c-4f87-b1fd-b0ef55a0ce90 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.218555 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0662b-976c-4f87-b1fd-b0ef55a0ce90 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.218833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0662b-976c-4f87-b1fd-b0ef55a0ce90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.237185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab1f98-07d8-43fe-8ba6-5a9d058d6187 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.245124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-bba0662b-976c-4f87-b1fd-b0ef55a0ce90 None None] MFA Rules not processed for user `1bfe7dcf64a74ff18eff30985c912e48`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:57.246418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-bba0662b-976c-4f87-b1fd-b0ef55a0ce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.291014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.291881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.292154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.292419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] PATH_INFO: `/v3/users/42f22d3f3ca448a8a0b0b54c6cd13b00` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.293648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f22d3f3ca448a8a0b0b54c6cd13b00)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.295571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.309118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 901/1827] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:57 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:57.313562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0662b-976c-4f87-b1fd-b0ef55a0ce90 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.315437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-bba0662b-976c-4f87-b1fd-b0ef55a0ce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.332289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0662b-976c-4f87-b1fd-b0ef55a0ce90 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.337928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc31729-2884-4446-abe8-b62dc6a4e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.338615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc31729-2884-4446-abe8-b62dc6a4e5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.338901 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc31729-2884-4446-abe8-b62dc6a4e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.339300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc31729-2884-4446-abe8-b62dc6a4e5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.340019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc31729-2884-4446-abe8-b62dc6a4e5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.341932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc31729-2884-4446-abe8-b62dc6a4e5a9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.344527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f22d3f3ca448a8a0b0b54c6cd13b00'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.352098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f22d3f3ca448a8a0b0b54c6cd13b00'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.352716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f22d3f3ca448a8a0b0b54c6cd13b00'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.365908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f22d3f3ca448a8a0b0b54c6cd13b00'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.366568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f22d3f3ca448a8a0b0b54c6cd13b00'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.368343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 902/1828] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:57 2021] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:57.372154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc31729-2884-4446-abe8-b62dc6a4e5a9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.373942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ddc31729-2884-4446-abe8-b62dc6a4e5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.381118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 927/1829] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:57 2021] DELETE /identity/v3/users/42f22d3f3ca448a8a0b0b54c6cd13b00 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:57.440989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc31729-2884-4446-abe8-b62dc6a4e5a9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.498713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40579c6e-d600-4639-9010-32de2958a5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.499313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40579c6e-d600-4639-9010-32de2958a5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.499598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40579c6e-d600-4639-9010-32de2958a5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.499876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40579c6e-d600-4639-9010-32de2958a5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.500628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40579c6e-d600-4639-9010-32de2958a5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.502637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40579c6e-d600-4639-9010-32de2958a5d3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.523147 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 903/1830] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:57 2021] POST /identity/v3/users => generated 309 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:57.527481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.537586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6899a3-b371-4e56-b848-ce616abc838b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.543119 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228849d-6d68-4461-aad5-3453cf627e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.543798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228849d-6d68-4461-aad5-3453cf627e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.544087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228849d-6d68-4461-aad5-3453cf627e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.544363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228849d-6d68-4461-aad5-3453cf627e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.545109 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228849d-6d68-4461-aad5-3453cf627e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.546730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228849d-6d68-4461-aad5-3453cf627e76 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.557481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 928/1831] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:36:57.561407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40579c6e-d600-4639-9010-32de2958a5d3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.571761 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40579c6e-d600-4639-9010-32de2958a5d3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.576623 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ee5f2-b344-4440-948c-c2e2594e7dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.577508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ee5f2-b344-4440-948c-c2e2594e7dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.577853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ee5f2-b344-4440-948c-c2e2594e7dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.578126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ee5f2-b344-4440-948c-c2e2594e7dfc admin admin] PATH_INFO: `/v3/projects/00d91d4e4a34414f81a04d21e2e564ea/users/f7030d39c56b4f199a422cea202ecb42/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.593302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ee5f2-b344-4440-948c-c2e2594e7dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d91d4e4a34414f81a04d21e2e564ea, user_id=f7030d39c56b4f199a422cea202ecb42, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.595965 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ee5f2-b344-4440-948c-c2e2594e7dfc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.609869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 904/1832] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:57 2021] PUT /identity/v3/projects/00d91d4e4a34414f81a04d21e2e564ea/users/f7030d39c56b4f199a422cea202ecb42/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:57.613949 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228849d-6d68-4461-aad5-3453cf627e76 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.624586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228849d-6d68-4461-aad5-3453cf627e76 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.657111 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ee5f2-b344-4440-948c-c2e2594e7dfc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.658975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9d4ee5f2-b344-4440-948c-c2e2594e7dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.699870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b32c-384d-41e0-a4ee-e7e16bb2a9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.700549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b32c-384d-41e0-a4ee-e7e16bb2a9ae admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.700830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b32c-384d-41e0-a4ee-e7e16bb2a9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.701105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b32c-384d-41e0-a4ee-e7e16bb2a9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.701872 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b32c-384d-41e0-a4ee-e7e16bb2a9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.703649 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b32c-384d-41e0-a4ee-e7e16bb2a9ae admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.716052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 929/1833] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:36:57.719517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b32c-384d-41e0-a4ee-e7e16bb2a9ae admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.743217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b32c-384d-41e0-a4ee-e7e16bb2a9ae admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.750942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d10561-5be6-4d77-9dd0-517388a5ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.752789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10561-5be6-4d77-9dd0-517388a5ee3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.753159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10561-5be6-4d77-9dd0-517388a5ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.753513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10561-5be6-4d77-9dd0-517388a5ee3f admin admin] PATH_INFO: `/v3/projects/00d91d4e4a34414f81a04d21e2e564ea/users/f7030d39c56b4f199a422cea202ecb42/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.756584 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d10561-5be6-4d77-9dd0-517388a5ee3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d91d4e4a34414f81a04d21e2e564ea, user_id=f7030d39c56b4f199a422cea202ecb42, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.761562 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d10561-5be6-4d77-9dd0-517388a5ee3f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.773517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 930/1834] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:57 2021] PUT /identity/v3/projects/00d91d4e4a34414f81a04d21e2e564ea/users/f7030d39c56b4f199a422cea202ecb42/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:57.784989 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b60e6f-ce24-45dd-aa92-4a5a20596ead None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.785279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b60e6f-ce24-45dd-aa92-4a5a20596ead None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.785560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b60e6f-ce24-45dd-aa92-4a5a20596ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.785650 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ee5f2-b344-4440-948c-c2e2594e7dfc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:57.813440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-35b60e6f-ce24-45dd-aa92-4a5a20596ead None None] MFA Rules not processed for user `f7030d39c56b4f199a422cea202ecb42`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:57.815583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-35b60e6f-ce24-45dd-aa92-4a5a20596ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.853202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:57.854252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:57.854579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:57.854922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] PATH_INFO: `/v3/projects/9e8938407c7444b0acbafd9e9e306ef9` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:57.856282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8938407c7444b0acbafd9e9e306ef9)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:57.858869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:57.902860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 931/1835] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:57 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:57.916081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b60e6f-ce24-45dd-aa92-4a5a20596ead None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:57.918820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-35b60e6f-ce24-45dd-aa92-4a5a20596ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:57.938150 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8938407c7444b0acbafd9e9e306ef9', 'request_id': 'req-a10e497c-d876-4450-8176-61b173d28a91'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.961056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8938407c7444b0acbafd9e9e306ef9', 'request_id': 'req-a10e497c-d876-4450-8176-61b173d28a91'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.971465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8938407c7444b0acbafd9e9e306ef9', 'request_id': 'req-a10e497c-d876-4450-8176-61b173d28a91'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.997221 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] The token cache is being invalidate because project 9e8938407c7444b0acbafd9e9e306ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:36:57.998411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:57.999280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a10e497c-d876-4450-8176-61b173d28a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:58.002701 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 905/1836] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:36:57 2021] DELETE /identity/v3/projects/9e8938407c7444b0acbafd9e9e306ef9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:58.012244 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde83fb5-ebac-4dfc-bd27-6d622fd8a502 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.013224 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde83fb5-ebac-4dfc-bd27-6d622fd8a502 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.013382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b60e6f-ce24-45dd-aa92-4a5a20596ead None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:58.013857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde83fb5-ebac-4dfc-bd27-6d622fd8a502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.039557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-cde83fb5-ebac-4dfc-bd27-6d622fd8a502 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:58.040882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-cde83fb5-ebac-4dfc-bd27-6d622fd8a502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:58.106283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e4006-713d-4409-9a4a-80a8b7ca2dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:58.109846 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4006-713d-4409-9a4a-80a8b7ca2dca service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.110874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4006-713d-4409-9a4a-80a8b7ca2dca service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.111802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4006-713d-4409-9a4a-80a8b7ca2dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.114195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ed5e4006-713d-4409-9a4a-80a8b7ca2dca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:58.119996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 906/1837] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:36:58.132507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c06c7-81ce-4da5-8b3d-5b0b4d2668ea None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.133009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c06c7-81ce-4da5-8b3d-5b0b4d2668ea None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.133545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c06c7-81ce-4da5-8b3d-5b0b4d2668ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.189134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-551c06c7-81ce-4da5-8b3d-5b0b4d2668ea None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:58.192161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-551c06c7-81ce-4da5-8b3d-5b0b4d2668ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:58.212678 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 907/1838] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:58.217596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c06c7-81ce-4da5-8b3d-5b0b4d2668ea None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:58.229962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e4006-713d-4409-9a4a-80a8b7ca2dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:58.231443 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e4006-713d-4409-9a4a-80a8b7ca2dca service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:58.231979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c06c7-81ce-4da5-8b3d-5b0b4d2668ea None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:58.238006 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbe673-d8bc-40b1-ab99-cd36c4f5089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:58.238859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbe673-d8bc-40b1-ab99-cd36c4f5089c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.239134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbe673-d8bc-40b1-ab99-cd36c4f5089c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.239400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbe673-d8bc-40b1-ab99-cd36c4f5089c admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.240130 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbe673-d8bc-40b1-ab99-cd36c4f5089c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:36:58.240433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbe673-d8bc-40b1-ab99-cd36c4f5089c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:58.242709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbe673-d8bc-40b1-ab99-cd36c4f5089c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:58.243543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 932/1839] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:57 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:36:58.258640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 908/1840] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:36:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:36:58.265964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e4006-713d-4409-9a4a-80a8b7ca2dca service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:58.283998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e4006-713d-4409-9a4a-80a8b7ca2dca service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:58.289191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ac0c-2eba-4ebf-b8cb-7fa1f0fa74ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:58.289964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ac0c-2eba-4ebf-b8cb-7fa1f0fa74ed admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.290181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ac0c-2eba-4ebf-b8cb-7fa1f0fa74ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.290458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ac0c-2eba-4ebf-b8cb-7fa1f0fa74ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.291167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398ac0c-2eba-4ebf-b8cb-7fa1f0fa74ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:58.293059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398ac0c-2eba-4ebf-b8cb-7fa1f0fa74ed admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:58.337381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 933/1841] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:58 2021] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:58.341672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbe673-d8bc-40b1-ab99-cd36c4f5089c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:58.352763 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbe673-d8bc-40b1-ab99-cd36c4f5089c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:58.425805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268db22-73cf-42bc-807e-681f82441212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:58.426481 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268db22-73cf-42bc-807e-681f82441212 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.426754 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268db22-73cf-42bc-807e-681f82441212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.427022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268db22-73cf-42bc-807e-681f82441212 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.427726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268db22-73cf-42bc-807e-681f82441212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:58.430407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268db22-73cf-42bc-807e-681f82441212 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:58.451790 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 909/1842] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:58 2021] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:58.455918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ac0c-2eba-4ebf-b8cb-7fa1f0fa74ed admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:58.466314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ac0c-2eba-4ebf-b8cb-7fa1f0fa74ed admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:58.471215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29a864-0836-4e03-82c0-7414f2aa20a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:58.471878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a864-0836-4e03-82c0-7414f2aa20a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.472161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a864-0836-4e03-82c0-7414f2aa20a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.472435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a864-0836-4e03-82c0-7414f2aa20a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.473177 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29a864-0836-4e03-82c0-7414f2aa20a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:58.475122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29a864-0836-4e03-82c0-7414f2aa20a7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:58.487084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 934/1843] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:58.491202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268db22-73cf-42bc-807e-681f82441212 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:58.501503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268db22-73cf-42bc-807e-681f82441212 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:58.506453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cd64d-09cb-4d6d-bd3e-306d6ff5223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:58.507120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cd64d-09cb-4d6d-bd3e-306d6ff5223e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.507399 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cd64d-09cb-4d6d-bd3e-306d6ff5223e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.508341 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cd64d-09cb-4d6d-bd3e-306d6ff5223e admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.509223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cd64d-09cb-4d6d-bd3e-306d6ff5223e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:58.510795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cd64d-09cb-4d6d-bd3e-306d6ff5223e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:58.520928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 910/1844] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:58.525214 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29a864-0836-4e03-82c0-7414f2aa20a7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:58.535296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29a864-0836-4e03-82c0-7414f2aa20a7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:58.540639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3569fe-3aa4-4a65-a5f0-c870f2ef744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:58.541518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3569fe-3aa4-4a65-a5f0-c870f2ef744b admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.541824 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3569fe-3aa4-4a65-a5f0-c870f2ef744b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.542095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3569fe-3aa4-4a65-a5f0-c870f2ef744b admin admin] PATH_INFO: `/v3/projects/27f132870b5b4acf9b96f0be357bb8d3/users/0d3b922358864c6a87cae57d71b6acbd/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.557034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3569fe-3aa4-4a65-a5f0-c870f2ef744b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f132870b5b4acf9b96f0be357bb8d3, user_id=0d3b922358864c6a87cae57d71b6acbd, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:58.559691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3569fe-3aa4-4a65-a5f0-c870f2ef744b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:58.575069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 935/1845] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:58 2021] PUT /identity/v3/projects/27f132870b5b4acf9b96f0be357bb8d3/users/0d3b922358864c6a87cae57d71b6acbd/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:36:58.584939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934aa4f2-2c28-4490-a61a-422238f17b43 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.586034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934aa4f2-2c28-4490-a61a-422238f17b43 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.586214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934aa4f2-2c28-4490-a61a-422238f17b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.612157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-934aa4f2-2c28-4490-a61a-422238f17b43 None None] MFA Rules not processed for user `0d3b922358864c6a87cae57d71b6acbd`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:58.613432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-934aa4f2-2c28-4490-a61a-422238f17b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:58.684721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 911/1846] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:58 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:58.689238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3569fe-3aa4-4a65-a5f0-c870f2ef744b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:58.764528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3569fe-3aa4-4a65-a5f0-c870f2ef744b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:58.769395 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85283aca-4dff-41e4-af85-c379c470150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:58.770116 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85283aca-4dff-41e4-af85-c379c470150d admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.770404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85283aca-4dff-41e4-af85-c379c470150d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.770676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85283aca-4dff-41e4-af85-c379c470150d admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.771419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85283aca-4dff-41e4-af85-c379c470150d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:58.773407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85283aca-4dff-41e4-af85-c379c470150d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:58.802454 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 936/1847] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:36:58 2021] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:36:58.803418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934aa4f2-2c28-4490-a61a-422238f17b43 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:58.814573 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934aa4f2-2c28-4490-a61a-422238f17b43 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:58.871587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0697bd-0741-4cd4-9094-86f4a4e5b71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:58.872265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0697bd-0741-4cd4-9094-86f4a4e5b71c admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.872672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0697bd-0741-4cd4-9094-86f4a4e5b71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.872954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0697bd-0741-4cd4-9094-86f4a4e5b71c admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.873672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0697bd-0741-4cd4-9094-86f4a4e5b71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:58.875645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0697bd-0741-4cd4-9094-86f4a4e5b71c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:58.900274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 912/1848] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:36:58 2021] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:36:58.903685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85283aca-4dff-41e4-af85-c379c470150d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:58.914421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85283aca-4dff-41e4-af85-c379c470150d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:58.919403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796a533-2704-403e-9338-c4ce9b3a11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:58.920188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796a533-2704-403e-9338-c4ce9b3a11f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.920474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796a533-2704-403e-9338-c4ce9b3a11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.920750 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796a533-2704-403e-9338-c4ce9b3a11f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.921484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796a533-2704-403e-9338-c4ce9b3a11f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:58.923101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796a533-2704-403e-9338-c4ce9b3a11f7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:58.937888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 937/1849] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:58 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:58.939262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0697bd-0741-4cd4-9094-86f4a4e5b71c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:58.949260 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0697bd-0741-4cd4-9094-86f4a4e5b71c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:58.954855 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69e058-36d6-4648-9a4c-829ba1617c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:58.955655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e058-36d6-4648-9a4c-829ba1617c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:58.956043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e058-36d6-4648-9a4c-829ba1617c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:58.956328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e058-36d6-4648-9a4c-829ba1617c57 admin admin] PATH_INFO: `/v3/projects/6b96b841694947e7942e2f9f63724835/users/e01d6ccc264e4bd594123fddb97bcde3/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:58.972602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69e058-36d6-4648-9a4c-829ba1617c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b96b841694947e7942e2f9f63724835, user_id=e01d6ccc264e4bd594123fddb97bcde3, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:58.975351 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69e058-36d6-4648-9a4c-829ba1617c57 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:58.990834 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 913/1850] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:58 2021] PUT /identity/v3/projects/6b96b841694947e7942e2f9f63724835/users/e01d6ccc264e4bd594123fddb97bcde3/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:58.995502 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796a533-2704-403e-9338-c4ce9b3a11f7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:59.005609 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796a533-2704-403e-9338-c4ce9b3a11f7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:59.066486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc79d9c-b4b0-4c35-b834-bf2f9135071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:59.067052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79d9c-b4b0-4c35-b834-bf2f9135071e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:59.067335 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79d9c-b4b0-4c35-b834-bf2f9135071e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:59.067610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79d9c-b4b0-4c35-b834-bf2f9135071e admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:59.068382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc79d9c-b4b0-4c35-b834-bf2f9135071e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:59.070487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc79d9c-b4b0-4c35-b834-bf2f9135071e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:59.081010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 938/1851] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:36:58 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:36:59.085225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69e058-36d6-4648-9a4c-829ba1617c57 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:59.095747 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69e058-36d6-4648-9a4c-829ba1617c57 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:59.100426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7a1d1-2963-4cf0-a27b-51aeb05e654f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:59.102019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a1d1-2963-4cf0-a27b-51aeb05e654f admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:59.102394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a1d1-2963-4cf0-a27b-51aeb05e654f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:59.102674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a1d1-2963-4cf0-a27b-51aeb05e654f admin admin] PATH_INFO: `/v3/projects/6b96b841694947e7942e2f9f63724835/users/e01d6ccc264e4bd594123fddb97bcde3/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:59.104685 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7a1d1-2963-4cf0-a27b-51aeb05e654f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b96b841694947e7942e2f9f63724835, user_id=e01d6ccc264e4bd594123fddb97bcde3, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:59.107356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7a1d1-2963-4cf0-a27b-51aeb05e654f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:59.118225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 914/1852] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:36:59 2021] PUT /identity/v3/projects/6b96b841694947e7942e2f9f63724835/users/e01d6ccc264e4bd594123fddb97bcde3/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:59.128837 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a67c5-f50e-497c-93f6-9686b342dabb None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:59.129301 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a67c5-f50e-497c-93f6-9686b342dabb None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:59.129699 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a67c5-f50e-497c-93f6-9686b342dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:59.159216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-584a67c5-f50e-497c-93f6-9686b342dabb None None] MFA Rules not processed for user `e01d6ccc264e4bd594123fddb97bcde3`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:59.160541 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-584a67c5-f50e-497c-93f6-9686b342dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:59.230175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 939/1853] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:59 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:59.255500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7a1d1-2963-4cf0-a27b-51aeb05e654f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:59.257455 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-cdf7a1d1-2963-4cf0-a27b-51aeb05e654f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:59.317510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a67c5-f50e-497c-93f6-9686b342dabb None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:59.319490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-584a67c5-f50e-497c-93f6-9686b342dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:59.323486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7a1d1-2963-4cf0-a27b-51aeb05e654f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:59.327703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a51b3-0339-4b9b-ac4a-d76010eea3b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:59.328363 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a51b3-0339-4b9b-ac4a-d76010eea3b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:59.328661 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a51b3-0339-4b9b-ac4a-d76010eea3b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:59.328916 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a51b3-0339-4b9b-ac4a-d76010eea3b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:59.338474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a67c5-f50e-497c-93f6-9686b342dabb None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:59.342827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1a48-7052-465a-9859-19940aac2d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:59.343485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1a48-7052-465a-9859-19940aac2d28 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:59.343770 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1a48-7052-465a-9859-19940aac2d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:59.344049 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1a48-7052-465a-9859-19940aac2d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:59.346140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b06c1a48-7052-465a-9859-19940aac2d28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:59.389916 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a51b3-0339-4b9b-ac4a-d76010eea3b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:59.391528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a51b3-0339-4b9b-ac4a-d76010eea3b8 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:59.401102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 915/1854] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:59 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:36:59.402060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a51b3-0339-4b9b-ac4a-d76010eea3b8 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:59.403464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1b9a51b3-0339-4b9b-ac4a-d76010eea3b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:59.412312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c1a48-7052-465a-9859-19940aac2d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:59.414381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c1a48-7052-465a-9859-19940aac2d28 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:59.424968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 940/1855] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:59 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:36:59.472884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a51b3-0339-4b9b-ac4a-d76010eea3b8 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:59.478358 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:59.479242 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:59.479503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:59.479964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] PATH_INFO: `/v3/users/1bfe7dcf64a74ff18eff30985c912e48` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:59.481164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bfe7dcf64a74ff18eff30985c912e48)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:59.483295 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:59.542234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bfe7dcf64a74ff18eff30985c912e48'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:59.550525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bfe7dcf64a74ff18eff30985c912e48'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:59.561464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bfe7dcf64a74ff18eff30985c912e48'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:59.577335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bfe7dcf64a74ff18eff30985c912e48'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:59.578212 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bfe7dcf64a74ff18eff30985c912e48'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:36:59.584519 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 916/1856] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:36:59 2021] DELETE /identity/v3/users/1bfe7dcf64a74ff18eff30985c912e48 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:36:59.589577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac5c80-0645-4063-80b3-6d997c3fd1c3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:59.590048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac5c80-0645-4063-80b3-6d997c3fd1c3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:59.590233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac5c80-0645-4063-80b3-6d997c3fd1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:59.614362 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d3ac5c80-0645-4063-80b3-6d997c3fd1c3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:36:59.615804 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d3ac5c80-0645-4063-80b3-6d997c3fd1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:59.705604 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 941/1857] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:36:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:36:59.715009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:36:59.716479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:36:59.781565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf43fe-bc60-4752-a9c2-f1fc98f826d1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:36:59.785326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8600ce-2834-47e5-88ae-8319ca3f4740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:36:59.786053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8600ce-2834-47e5-88ae-8319ca3f4740 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:36:59.786332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8600ce-2834-47e5-88ae-8319ca3f4740 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:36:59.786609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8600ce-2834-47e5-88ae-8319ca3f4740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:36:59.796935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8600ce-2834-47e5-88ae-8319ca3f4740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:36:59.798444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8600ce-2834-47e5-88ae-8319ca3f4740 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:36:59.808955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 917/1858] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:36:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:00.083787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac5c80-0645-4063-80b3-6d997c3fd1c3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:00.086619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d3ac5c80-0645-4063-80b3-6d997c3fd1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:00.103946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac5c80-0645-4063-80b3-6d997c3fd1c3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:00.108597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:00.109474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:00.109829 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:00.110110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] PATH_INFO: `/v3/projects/452064599a594e7f85e8db263c4b417c` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:00.112463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=452064599a594e7f85e8db263c4b417c)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:00.114691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:00.165930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '452064599a594e7f85e8db263c4b417c', 'request_id': 'req-68992377-5aae-42c8-b918-26296eaaf98e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.172410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '452064599a594e7f85e8db263c4b417c', 'request_id': 'req-68992377-5aae-42c8-b918-26296eaaf98e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.181696 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '452064599a594e7f85e8db263c4b417c', 'request_id': 'req-68992377-5aae-42c8-b918-26296eaaf98e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.192208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] The token cache is being invalidate because project 452064599a594e7f85e8db263c4b417c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:00.192499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.193325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.194807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 942/1859] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:00 2021] DELETE /identity/v3/projects/452064599a594e7f85e8db263c4b417c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:00.199124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8600ce-2834-47e5-88ae-8319ca3f4740 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:00.209721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8600ce-2834-47e5-88ae-8319ca3f4740 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:00.278672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307877f7-4294-4f7a-a312-eef010158b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:00.279554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307877f7-4294-4f7a-a312-eef010158b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:00.279833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307877f7-4294-4f7a-a312-eef010158b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:00.280105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307877f7-4294-4f7a-a312-eef010158b45 admin admin] PATH_INFO: `/v3/users/f7030d39c56b4f199a422cea202ecb42` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:00.281343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307877f7-4294-4f7a-a312-eef010158b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7030d39c56b4f199a422cea202ecb42)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:00.283302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307877f7-4294-4f7a-a312-eef010158b45 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:00.345872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-307877f7-4294-4f7a-a312-eef010158b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7030d39c56b4f199a422cea202ecb42'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.358285 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-307877f7-4294-4f7a-a312-eef010158b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7030d39c56b4f199a422cea202ecb42'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.369189 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-307877f7-4294-4f7a-a312-eef010158b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7030d39c56b4f199a422cea202ecb42'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.383300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-307877f7-4294-4f7a-a312-eef010158b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7030d39c56b4f199a422cea202ecb42'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.386027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-307877f7-4294-4f7a-a312-eef010158b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7030d39c56b4f199a422cea202ecb42'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.396241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 918/1860] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:00 2021] DELETE /identity/v3/users/f7030d39c56b4f199a422cea202ecb42 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:00.701132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:00.702784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:00.719145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68992377-5aae-42c8-b918-26296eaaf98e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:00.802725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:00.803597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:00.803884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:00.804164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] PATH_INFO: `/v3/projects/00d91d4e4a34414f81a04d21e2e564ea` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:00.805441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d91d4e4a34414f81a04d21e2e564ea)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:00.807463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:00.980277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d91d4e4a34414f81a04d21e2e564ea', 'request_id': 'req-82ee975f-24b5-482f-9212-939ddd490556'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.986777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d91d4e4a34414f81a04d21e2e564ea', 'request_id': 'req-82ee975f-24b5-482f-9212-939ddd490556'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:00.995676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d91d4e4a34414f81a04d21e2e564ea', 'request_id': 'req-82ee975f-24b5-482f-9212-939ddd490556'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:01.007308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] The token cache is being invalidate because project 00d91d4e4a34414f81a04d21e2e564ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:01.007308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:01.007971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-82ee975f-24b5-482f-9212-939ddd490556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:01.010557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 943/1861] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:00 2021] DELETE /identity/v3/projects/00d91d4e4a34414f81a04d21e2e564ea => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:01.015930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045ff4-706e-4451-b5a2-cf1d830e748c None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.016227 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045ff4-706e-4451-b5a2-cf1d830e748c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.016507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045ff4-706e-4451-b5a2-cf1d830e748c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.039958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-3c045ff4-706e-4451-b5a2-cf1d830e748c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:01.041627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3c045ff4-706e-4451-b5a2-cf1d830e748c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:01.107070 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 919/1862] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:01.115085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16d9d-6375-4680-ba6e-7bc4d824072d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.115376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16d9d-6375-4680-ba6e-7bc4d824072d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.115655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16d9d-6375-4680-ba6e-7bc4d824072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.134562 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-dbe16d9d-6375-4680-ba6e-7bc4d824072d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:01.135772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-dbe16d9d-6375-4680-ba6e-7bc4d824072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:01.144797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 944/1863] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:01.149047 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c045ff4-706e-4451-b5a2-cf1d830e748c None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:01.158461 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c045ff4-706e-4451-b5a2-cf1d830e748c None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:01.162977 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196c4c0-1c99-4ecb-92c5-3858a911ce11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:01.164158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196c4c0-1c99-4ecb-92c5-3858a911ce11 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.164420 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196c4c0-1c99-4ecb-92c5-3858a911ce11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.164690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196c4c0-1c99-4ecb-92c5-3858a911ce11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.165427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196c4c0-1c99-4ecb-92c5-3858a911ce11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:01.165727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196c4c0-1c99-4ecb-92c5-3858a911ce11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:01.167337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196c4c0-1c99-4ecb-92c5-3858a911ce11 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:01.178421 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 920/1864] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:01.183063 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe16d9d-6375-4680-ba6e-7bc4d824072d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:01.192181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe16d9d-6375-4680-ba6e-7bc4d824072d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:01.198678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6935a5-5e2e-4dce-93c4-ee5067e63eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:01.199351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6935a5-5e2e-4dce-93c4-ee5067e63eaf admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.199628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6935a5-5e2e-4dce-93c4-ee5067e63eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.199903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6935a5-5e2e-4dce-93c4-ee5067e63eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.200626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6935a5-5e2e-4dce-93c4-ee5067e63eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:01.202554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6935a5-5e2e-4dce-93c4-ee5067e63eaf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:01.237653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 945/1865] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:01 2021] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:01.239891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196c4c0-1c99-4ecb-92c5-3858a911ce11 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:01.251788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196c4c0-1c99-4ecb-92c5-3858a911ce11 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:01.309905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b816bc8-25be-4370-95e8-1185dab0ed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:01.311281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b816bc8-25be-4370-95e8-1185dab0ed3c admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.311659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b816bc8-25be-4370-95e8-1185dab0ed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.312132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b816bc8-25be-4370-95e8-1185dab0ed3c admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.313364 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b816bc8-25be-4370-95e8-1185dab0ed3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:01.316653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b816bc8-25be-4370-95e8-1185dab0ed3c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:01.338357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 921/1866] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:01 2021] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:01.342412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6935a5-5e2e-4dce-93c4-ee5067e63eaf admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:01.352802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6935a5-5e2e-4dce-93c4-ee5067e63eaf admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:01.357386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea7a75-6f83-4b25-aa27-9de86d2a7720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:01.358069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea7a75-6f83-4b25-aa27-9de86d2a7720 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.358349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea7a75-6f83-4b25-aa27-9de86d2a7720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.358619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea7a75-6f83-4b25-aa27-9de86d2a7720 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.359344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea7a75-6f83-4b25-aa27-9de86d2a7720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:01.361018 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea7a75-6f83-4b25-aa27-9de86d2a7720 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:01.370710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 946/1867] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:01.374584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b816bc8-25be-4370-95e8-1185dab0ed3c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:01.384329 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b816bc8-25be-4370-95e8-1185dab0ed3c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:01.389205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cf75f-ead9-4d19-b5c2-c4773c2d280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:01.389905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf75f-ead9-4d19-b5c2-c4773c2d280c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.390191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf75f-ead9-4d19-b5c2-c4773c2d280c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.390467 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf75f-ead9-4d19-b5c2-c4773c2d280c admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.391204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cf75f-ead9-4d19-b5c2-c4773c2d280c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:01.392817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cf75f-ead9-4d19-b5c2-c4773c2d280c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:01.403076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 922/1868] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:01.407190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea7a75-6f83-4b25-aa27-9de86d2a7720 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:01.417345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea7a75-6f83-4b25-aa27-9de86d2a7720 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:01.421976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9ce7-3eb0-47b6-8801-78003f04c238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:01.422969 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9ce7-3eb0-47b6-8801-78003f04c238 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.423245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9ce7-3eb0-47b6-8801-78003f04c238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.423513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9ce7-3eb0-47b6-8801-78003f04c238 admin admin] PATH_INFO: `/v3/projects/a7f930ed6b8e4446994541b65e9782d6/users/9f27150d1d144ec29973c996bc93b5b3/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.438464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee9ce7-3eb0-47b6-8801-78003f04c238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f930ed6b8e4446994541b65e9782d6, user_id=9f27150d1d144ec29973c996bc93b5b3, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:01.441097 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee9ce7-3eb0-47b6-8801-78003f04c238 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:01.455108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 947/1869] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:01 2021] PUT /identity/v3/projects/a7f930ed6b8e4446994541b65e9782d6/users/9f27150d1d144ec29973c996bc93b5b3/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:01.466161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57105-1111-4e00-8fa4-2b01438d3979 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.466544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57105-1111-4e00-8fa4-2b01438d3979 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.467073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf57105-1111-4e00-8fa4-2b01438d3979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.499813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-0bf57105-1111-4e00-8fa4-2b01438d3979 None None] MFA Rules not processed for user `9f27150d1d144ec29973c996bc93b5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:01.501241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0bf57105-1111-4e00-8fa4-2b01438d3979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:01.574166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 923/1870] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:01 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:01.578773 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9ce7-3eb0-47b6-8801-78003f04c238 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:01.645880 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9ce7-3eb0-47b6-8801-78003f04c238 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:01.651190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ae3da-ebbf-41d0-a3a0-22b7d9d60657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:01.651857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ae3da-ebbf-41d0-a3a0-22b7d9d60657 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.652141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ae3da-ebbf-41d0-a3a0-22b7d9d60657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.652701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ae3da-ebbf-41d0-a3a0-22b7d9d60657 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.653489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ae3da-ebbf-41d0-a3a0-22b7d9d60657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:01.655426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ae3da-ebbf-41d0-a3a0-22b7d9d60657 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:01.708200 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf57105-1111-4e00-8fa4-2b01438d3979 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:01.718505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 948/1871] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:01 2021] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:01.722667 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf57105-1111-4e00-8fa4-2b01438d3979 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:01.795730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4774e-a997-4da5-a525-0fd6d02d0f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:01.797498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4774e-a997-4da5-a525-0fd6d02d0f20 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.797498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4774e-a997-4da5-a525-0fd6d02d0f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.797498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4774e-a997-4da5-a525-0fd6d02d0f20 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.798259 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4774e-a997-4da5-a525-0fd6d02d0f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:01.801179 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4774e-a997-4da5-a525-0fd6d02d0f20 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:01.836919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 924/1872] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:01 2021] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:01.841343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ae3da-ebbf-41d0-a3a0-22b7d9d60657 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:01.854910 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ae3da-ebbf-41d0-a3a0-22b7d9d60657 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:01.871798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1edd1-9a40-43bd-9159-8a158fb99ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:01.872742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1edd1-9a40-43bd-9159-8a158fb99ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.873207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1edd1-9a40-43bd-9159-8a158fb99ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.873739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1edd1-9a40-43bd-9159-8a158fb99ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.874829 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1edd1-9a40-43bd-9159-8a158fb99ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:01.876615 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1edd1-9a40-43bd-9159-8a158fb99ee9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:01.901308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 949/1873] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:01 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:01.902578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4774e-a997-4da5-a525-0fd6d02d0f20 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:01.914472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4774e-a997-4da5-a525-0fd6d02d0f20 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:01.920976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e1e30-780e-41fc-8526-e9de428f231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:01.921902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e1e30-780e-41fc-8526-e9de428f231c admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:01.922180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e1e30-780e-41fc-8526-e9de428f231c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:01.922477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e1e30-780e-41fc-8526-e9de428f231c admin admin] PATH_INFO: `/v3/projects/d04aea0d34874ed1b171fdf0ce5f5941/users/8d89bb7c08db424487b7b170648e721d/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:01.938594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e1e30-780e-41fc-8526-e9de428f231c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04aea0d34874ed1b171fdf0ce5f5941, user_id=8d89bb7c08db424487b7b170648e721d, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:01.941267 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e1e30-780e-41fc-8526-e9de428f231c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:01.957153 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 925/1874] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:01 2021] PUT /identity/v3/projects/d04aea0d34874ed1b171fdf0ce5f5941/users/8d89bb7c08db424487b7b170648e721d/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:01.962144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1edd1-9a40-43bd-9159-8a158fb99ee9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:01.974017 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1edd1-9a40-43bd-9159-8a158fb99ee9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:02.047707 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4e0c4-27aa-4198-895a-20036c934d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:02.049979 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e0c4-27aa-4198-895a-20036c934d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:02.049979 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e0c4-27aa-4198-895a-20036c934d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:02.049979 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e0c4-27aa-4198-895a-20036c934d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:02.049979 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4e0c4-27aa-4198-895a-20036c934d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:02.051660 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4e0c4-27aa-4198-895a-20036c934d77 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:02.063984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 950/1875] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:01 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:02.067694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e1e30-780e-41fc-8526-e9de428f231c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:02.082568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e1e30-780e-41fc-8526-e9de428f231c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:02.091809 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a33117-c54a-4200-abd7-5ee3d970d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:02.093581 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33117-c54a-4200-abd7-5ee3d970d537 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:02.093971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33117-c54a-4200-abd7-5ee3d970d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:02.094508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33117-c54a-4200-abd7-5ee3d970d537 admin admin] PATH_INFO: `/v3/projects/d04aea0d34874ed1b171fdf0ce5f5941/users/8d89bb7c08db424487b7b170648e721d/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:02.097442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a33117-c54a-4200-abd7-5ee3d970d537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04aea0d34874ed1b171fdf0ce5f5941, user_id=8d89bb7c08db424487b7b170648e721d, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:02.100225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a33117-c54a-4200-abd7-5ee3d970d537 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:02.114020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 926/1876] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:02 2021] PUT /identity/v3/projects/d04aea0d34874ed1b171fdf0ce5f5941/users/8d89bb7c08db424487b7b170648e721d/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:02.135317 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4f3a-4ed7-4611-aebb-b51c4c946b64 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:02.135645 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4f3a-4ed7-4611-aebb-b51c4c946b64 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:02.135932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4f3a-4ed7-4611-aebb-b51c4c946b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:02.166238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-accb4f3a-4ed7-4611-aebb-b51c4c946b64 None None] MFA Rules not processed for user `8d89bb7c08db424487b7b170648e721d`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:02.167537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-accb4f3a-4ed7-4611-aebb-b51c4c946b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:02.248676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 951/1877] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:02 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:02.267254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a33117-c54a-4200-abd7-5ee3d970d537 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:02.269041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-17a33117-c54a-4200-abd7-5ee3d970d537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:02.350579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a33117-c54a-4200-abd7-5ee3d970d537 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:02.356677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada158d-1055-44e7-9738-16b316ae73e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:02.357471 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada158d-1055-44e7-9738-16b316ae73e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:02.357901 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada158d-1055-44e7-9738-16b316ae73e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:02.358283 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada158d-1055-44e7-9738-16b316ae73e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:02.370478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada158d-1055-44e7-9738-16b316ae73e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:02.372090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada158d-1055-44e7-9738-16b316ae73e0 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:02.383826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 927/1878] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:02 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:02.470461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb4f3a-4ed7-4611-aebb-b51c4c946b64 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:02.480915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb4f3a-4ed7-4611-aebb-b51c4c946b64 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:02.484870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a00d7-b8c3-4661-b5aa-1b7330aba952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:02.485534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a00d7-b8c3-4661-b5aa-1b7330aba952 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:02.485850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a00d7-b8c3-4661-b5aa-1b7330aba952 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:02.486125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a00d7-b8c3-4661-b5aa-1b7330aba952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:02.543650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a00d7-b8c3-4661-b5aa-1b7330aba952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:02.545149 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a00d7-b8c3-4661-b5aa-1b7330aba952 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:02.555751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 952/1879] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:02 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:04.431462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71554f10-d817-4ae3-9ef8-0a3873343cfe None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:04.431980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71554f10-d817-4ae3-9ef8-0a3873343cfe None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:04.432420 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71554f10-d817-4ae3-9ef8-0a3873343cfe None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:04.434615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 928/1880] 10.222.0.83 () {54 vars in 921 bytes} [Wed Dec 15 13:37:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:37:04.455796 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dbb73-175a-44fc-86e0-9700de423cd6 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:04.456241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dbb73-175a-44fc-86e0-9700de423cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:04.456241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dbb73-175a-44fc-86e0-9700de423cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:04.475669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-892dbb73-175a-44fc-86e0-9700de423cd6 None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:04.476970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-892dbb73-175a-44fc-86e0-9700de423cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:04.542983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 953/1881] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Dec 15 13:37:04 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:04.560870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71554f10-d817-4ae3-9ef8-0a3873343cfe None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:04.562797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-71554f10-d817-4ae3-9ef8-0a3873343cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:04.580746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71554f10-d817-4ae3-9ef8-0a3873343cfe None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:04.586268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5870a60-47d0-4ddc-bb3f-93749942bb99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:04.586941 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5870a60-47d0-4ddc-bb3f-93749942bb99 service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:04.587216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5870a60-47d0-4ddc-bb3f-93749942bb99 service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:04.587486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5870a60-47d0-4ddc-bb3f-93749942bb99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:04.596253 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5870a60-47d0-4ddc-bb3f-93749942bb99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:04.597846 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5870a60-47d0-4ddc-bb3f-93749942bb99 service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:04.608127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 929/1882] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:06.185838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dbb73-175a-44fc-86e0-9700de423cd6 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:06.187412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-892dbb73-175a-44fc-86e0-9700de423cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:06.200100 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dbb73-175a-44fc-86e0-9700de423cd6 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:06.203782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5ec5d-f120-44d8-b928-162583c5d3c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:06.204424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ec5d-f120-44d8-b928-162583c5d3c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:06.204699 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ec5d-f120-44d8-b928-162583c5d3c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:06.204969 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ec5d-f120-44d8-b928-162583c5d3c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:06.206841 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c7d5ec5d-f120-44d8-b928-162583c5d3c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:06.274554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5ec5d-f120-44d8-b928-162583c5d3c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:06.276140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5ec5d-f120-44d8-b928-162583c5d3c7 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:06.287532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 954/1883] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:06 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:06.872201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5870a60-47d0-4ddc-bb3f-93749942bb99 service nova] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:06.889464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5870a60-47d0-4ddc-bb3f-93749942bb99 service nova] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:06.898338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628d615-2a82-41a3-9ac3-92a51c2cbff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:06.900588 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628d615-2a82-41a3-9ac3-92a51c2cbff8 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:06.900781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628d615-2a82-41a3-9ac3-92a51c2cbff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:06.901081 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628d615-2a82-41a3-9ac3-92a51c2cbff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:06.903341 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9628d615-2a82-41a3-9ac3-92a51c2cbff8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:06.974659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628d615-2a82-41a3-9ac3-92a51c2cbff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:06.976735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628d615-2a82-41a3-9ac3-92a51c2cbff8 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:06.986384 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 930/1884] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:06 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:07.283982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5ec5d-f120-44d8-b928-162583c5d3c7 service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:07.345725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5ec5d-f120-44d8-b928-162583c5d3c7 service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:07.350261 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:07.351117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:07.351434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:07.352240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] PATH_INFO: `/v3/users/9f27150d1d144ec29973c996bc93b5b3` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:07.353390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f27150d1d144ec29973c996bc93b5b3)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:07.355318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:07.399178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f27150d1d144ec29973c996bc93b5b3'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:07.405776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f27150d1d144ec29973c996bc93b5b3'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:07.406435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f27150d1d144ec29973c996bc93b5b3'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:07.418436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f27150d1d144ec29973c996bc93b5b3'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:07.419082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f27150d1d144ec29973c996bc93b5b3'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:07.431197 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 955/1885] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:07 2021] DELETE /identity/v3/users/9f27150d1d144ec29973c996bc93b5b3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:07.435863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898b9aa-a884-415a-8a86-523832fd437a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:07.436149 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898b9aa-a884-415a-8a86-523832fd437a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:07.436443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898b9aa-a884-415a-8a86-523832fd437a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:07.453672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d898b9aa-a884-415a-8a86-523832fd437a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:07.454879 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d898b9aa-a884-415a-8a86-523832fd437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:07.510521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 931/1886] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:07.520203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:07.521581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:07.577164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb2ca-9e96-4a10-a029-74f894c5342e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:07.580721 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaccfcd-2b36-4762-8f5b-08fb92cf37cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:07.581342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaccfcd-2b36-4762-8f5b-08fb92cf37cb service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:07.581622 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaccfcd-2b36-4762-8f5b-08fb92cf37cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:07.581933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaccfcd-2b36-4762-8f5b-08fb92cf37cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:07.590649 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaccfcd-2b36-4762-8f5b-08fb92cf37cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:07.592055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaccfcd-2b36-4762-8f5b-08fb92cf37cb service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:07.601114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 956/1887] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:07.892855 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898b9aa-a884-415a-8a86-523832fd437a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:07.894612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d898b9aa-a884-415a-8a86-523832fd437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:07.909237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898b9aa-a884-415a-8a86-523832fd437a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:07.937529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:07.938439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:07.938722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:07.938995 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] PATH_INFO: `/v3/projects/a7f930ed6b8e4446994541b65e9782d6` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:07.940321 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f930ed6b8e4446994541b65e9782d6)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:07.942270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:08.062761 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f930ed6b8e4446994541b65e9782d6', 'request_id': 'req-19e38f72-f8bf-47e7-a2df-8d3ba7028216'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.069996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f930ed6b8e4446994541b65e9782d6', 'request_id': 'req-19e38f72-f8bf-47e7-a2df-8d3ba7028216'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.080606 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f930ed6b8e4446994541b65e9782d6', 'request_id': 'req-19e38f72-f8bf-47e7-a2df-8d3ba7028216'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.096884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] The token cache is being invalidate because project a7f930ed6b8e4446994541b65e9782d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:08.097099 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.097942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.099982 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 932/1888] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:07 2021] DELETE /identity/v3/projects/a7f930ed6b8e4446994541b65e9782d6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:08.105288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaccfcd-2b36-4762-8f5b-08fb92cf37cb service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:08.116384 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaccfcd-2b36-4762-8f5b-08fb92cf37cb service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:08.199102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a336c06-93e4-4a9b-bc88-68d606c83d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:08.201097 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a336c06-93e4-4a9b-bc88-68d606c83d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:08.201485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a336c06-93e4-4a9b-bc88-68d606c83d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:08.201894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a336c06-93e4-4a9b-bc88-68d606c83d5f admin admin] PATH_INFO: `/v3/users/8d89bb7c08db424487b7b170648e721d` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:08.203307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a336c06-93e4-4a9b-bc88-68d606c83d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d89bb7c08db424487b7b170648e721d)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:08.205414 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a336c06-93e4-4a9b-bc88-68d606c83d5f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:08.272347 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9a336c06-93e4-4a9b-bc88-68d606c83d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d89bb7c08db424487b7b170648e721d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.280071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9a336c06-93e4-4a9b-bc88-68d606c83d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d89bb7c08db424487b7b170648e721d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.280749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9a336c06-93e4-4a9b-bc88-68d606c83d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d89bb7c08db424487b7b170648e721d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.295437 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9a336c06-93e4-4a9b-bc88-68d606c83d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d89bb7c08db424487b7b170648e721d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.296183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9a336c06-93e4-4a9b-bc88-68d606c83d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d89bb7c08db424487b7b170648e721d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.310892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 957/1889] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:08 2021] DELETE /identity/v3/users/8d89bb7c08db424487b7b170648e721d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:08.583373 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:08.584985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:08.599258 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e38f72-f8bf-47e7-a2df-8d3ba7028216 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:08.662819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:08.663791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:08.664069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:08.664339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] PATH_INFO: `/v3/projects/d04aea0d34874ed1b171fdf0ce5f5941` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:08.665548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04aea0d34874ed1b171fdf0ce5f5941)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:08.667482 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:08.712695 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04aea0d34874ed1b171fdf0ce5f5941', 'request_id': 'req-73f0564a-584b-489c-8f93-4db545af9869'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.719956 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04aea0d34874ed1b171fdf0ce5f5941', 'request_id': 'req-73f0564a-584b-489c-8f93-4db545af9869'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.728078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04aea0d34874ed1b171fdf0ce5f5941', 'request_id': 'req-73f0564a-584b-489c-8f93-4db545af9869'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.738651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] The token cache is being invalidate because project d04aea0d34874ed1b171fdf0ce5f5941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:08.738935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.739571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-73f0564a-584b-489c-8f93-4db545af9869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:08.744392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 933/1890] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:08 2021] DELETE /identity/v3/projects/d04aea0d34874ed1b171fdf0ce5f5941 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:08.746931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d3023-9c63-4eac-b84b-1ff52a706332 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:08.747217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d3023-9c63-4eac-b84b-1ff52a706332 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:08.747493 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d3023-9c63-4eac-b84b-1ff52a706332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:08.766309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5b3d3023-9c63-4eac-b84b-1ff52a706332 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:08.767513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5b3d3023-9c63-4eac-b84b-1ff52a706332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:08.834468 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 958/1891] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:08.843190 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a463f5-d509-4505-b132-0489a1c36e42 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:08.843484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a463f5-d509-4505-b132-0489a1c36e42 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:08.843893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a463f5-d509-4505-b132-0489a1c36e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:08.862479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e1a463f5-d509-4505-b132-0489a1c36e42 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:08.863670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e1a463f5-d509-4505-b132-0489a1c36e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:08.873337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 934/1892] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:08.877573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d3023-9c63-4eac-b84b-1ff52a706332 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:08.887915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d3023-9c63-4eac-b84b-1ff52a706332 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:08.894270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136271dc-74eb-4b22-a170-e92ff8d7e816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:08.894938 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136271dc-74eb-4b22-a170-e92ff8d7e816 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:08.895217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136271dc-74eb-4b22-a170-e92ff8d7e816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:08.895489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136271dc-74eb-4b22-a170-e92ff8d7e816 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:08.896282 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136271dc-74eb-4b22-a170-e92ff8d7e816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:08.896559 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136271dc-74eb-4b22-a170-e92ff8d7e816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:08.898334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136271dc-74eb-4b22-a170-e92ff8d7e816 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:08.912111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 959/1893] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:08.916487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a463f5-d509-4505-b132-0489a1c36e42 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:08.925516 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a463f5-d509-4505-b132-0489a1c36e42 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:08.930764 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53cc6a-1164-4682-ab27-f0b28775e1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:08.931556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53cc6a-1164-4682-ab27-f0b28775e1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:08.931835 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53cc6a-1164-4682-ab27-f0b28775e1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:08.932106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53cc6a-1164-4682-ab27-f0b28775e1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:08.932825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53cc6a-1164-4682-ab27-f0b28775e1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:08.934758 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53cc6a-1164-4682-ab27-f0b28775e1e6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:08.961379 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 935/1894] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:08 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:08.965136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136271dc-74eb-4b22-a170-e92ff8d7e816 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:08.974897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136271dc-74eb-4b22-a170-e92ff8d7e816 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:09.036886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439676d-44ac-4d33-8cc9-934221abfb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:09.037641 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439676d-44ac-4d33-8cc9-934221abfb42 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.037969 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439676d-44ac-4d33-8cc9-934221abfb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.038244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439676d-44ac-4d33-8cc9-934221abfb42 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.038986 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439676d-44ac-4d33-8cc9-934221abfb42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:09.040930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439676d-44ac-4d33-8cc9-934221abfb42 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:09.063470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 960/1895] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:08 2021] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:09.067551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53cc6a-1164-4682-ab27-f0b28775e1e6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:09.079702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53cc6a-1164-4682-ab27-f0b28775e1e6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:09.084485 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa058c1f-4885-4dd5-9c3a-15c95a61b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:09.085167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa058c1f-4885-4dd5-9c3a-15c95a61b928 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.085452 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa058c1f-4885-4dd5-9c3a-15c95a61b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.085959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa058c1f-4885-4dd5-9c3a-15c95a61b928 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.087271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa058c1f-4885-4dd5-9c3a-15c95a61b928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:09.088961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa058c1f-4885-4dd5-9c3a-15c95a61b928 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:09.106705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 936/1896] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:09 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:09.110958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439676d-44ac-4d33-8cc9-934221abfb42 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:09.121681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439676d-44ac-4d33-8cc9-934221abfb42 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:09.126810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071f3a2-3f05-4f73-9f8d-4b5e7ecb5919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:09.127486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071f3a2-3f05-4f73-9f8d-4b5e7ecb5919 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.127770 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071f3a2-3f05-4f73-9f8d-4b5e7ecb5919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.128220 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071f3a2-3f05-4f73-9f8d-4b5e7ecb5919 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.128966 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071f3a2-3f05-4f73-9f8d-4b5e7ecb5919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:09.130618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071f3a2-3f05-4f73-9f8d-4b5e7ecb5919 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:09.142830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 961/1897] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:09.147022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa058c1f-4885-4dd5-9c3a-15c95a61b928 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:09.157454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa058c1f-4885-4dd5-9c3a-15c95a61b928 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:09.162870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ae60e-b2ed-4e05-abe9-42c218cf74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:09.163836 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ae60e-b2ed-4e05-abe9-42c218cf74ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.164219 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ae60e-b2ed-4e05-abe9-42c218cf74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.164382 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ae60e-b2ed-4e05-abe9-42c218cf74ac admin admin] PATH_INFO: `/v3/projects/105097d4947f4140bb239dbca0de6e99/users/9b9ab3f43c644c43beddbe555865ae96/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.179827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ae60e-b2ed-4e05-abe9-42c218cf74ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=105097d4947f4140bb239dbca0de6e99, user_id=9b9ab3f43c644c43beddbe555865ae96, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:09.182622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ae60e-b2ed-4e05-abe9-42c218cf74ac admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:09.200022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 937/1898] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:09 2021] PUT /identity/v3/projects/105097d4947f4140bb239dbca0de6e99/users/9b9ab3f43c644c43beddbe555865ae96/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:09.211804 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779efc-f6c5-40c4-86b4-ead0791f0c32 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.212096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779efc-f6c5-40c4-86b4-ead0791f0c32 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.212382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779efc-f6c5-40c4-86b4-ead0791f0c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.239833 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e3779efc-f6c5-40c4-86b4-ead0791f0c32 None None] MFA Rules not processed for user `9b9ab3f43c644c43beddbe555865ae96`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:09.241128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e3779efc-f6c5-40c4-86b4-ead0791f0c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:09.312447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 962/1899] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:09 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:09.317642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ae60e-b2ed-4e05-abe9-42c218cf74ac admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:09.379203 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ae60e-b2ed-4e05-abe9-42c218cf74ac admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:09.383882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c32a22-a972-4917-b77e-ecbdcd273e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:09.384533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c32a22-a972-4917-b77e-ecbdcd273e61 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.384807 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c32a22-a972-4917-b77e-ecbdcd273e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.385077 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c32a22-a972-4917-b77e-ecbdcd273e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.385784 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c32a22-a972-4917-b77e-ecbdcd273e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:09.387654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c32a22-a972-4917-b77e-ecbdcd273e61 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:09.411197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 938/1900] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:09 2021] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:09.415694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3779efc-f6c5-40c4-86b4-ead0791f0c32 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:09.425933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3779efc-f6c5-40c4-86b4-ead0791f0c32 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:09.483138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e69b7b-3c18-4fb4-a7ad-eb979448cb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:09.484157 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e69b7b-3c18-4fb4-a7ad-eb979448cb9f admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.484447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e69b7b-3c18-4fb4-a7ad-eb979448cb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.484723 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e69b7b-3c18-4fb4-a7ad-eb979448cb9f admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.485427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e69b7b-3c18-4fb4-a7ad-eb979448cb9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:09.487351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e69b7b-3c18-4fb4-a7ad-eb979448cb9f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:09.507770 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 963/1901] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:09 2021] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:09.512095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c32a22-a972-4917-b77e-ecbdcd273e61 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:09.522138 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c32a22-a972-4917-b77e-ecbdcd273e61 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:09.526939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19793934-3f34-4e76-8389-c307f8d0c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:09.527600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19793934-3f34-4e76-8389-c307f8d0c423 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.527878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19793934-3f34-4e76-8389-c307f8d0c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.528152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19793934-3f34-4e76-8389-c307f8d0c423 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.528888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19793934-3f34-4e76-8389-c307f8d0c423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:09.530547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19793934-3f34-4e76-8389-c307f8d0c423 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:09.541982 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 939/1902] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:09.546163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e69b7b-3c18-4fb4-a7ad-eb979448cb9f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:09.556691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e69b7b-3c18-4fb4-a7ad-eb979448cb9f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:09.561552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bff2d-24b1-4dc3-a49a-5eee45057b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:09.562463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bff2d-24b1-4dc3-a49a-5eee45057b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.562740 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bff2d-24b1-4dc3-a49a-5eee45057b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.563011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bff2d-24b1-4dc3-a49a-5eee45057b7a admin admin] PATH_INFO: `/v3/projects/ad23dcf3f8674a2091e36238f9226624/users/fa17d0c4d61f4b199984043c5b78ba0c/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.577475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bff2d-24b1-4dc3-a49a-5eee45057b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad23dcf3f8674a2091e36238f9226624, user_id=fa17d0c4d61f4b199984043c5b78ba0c, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:09.580168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bff2d-24b1-4dc3-a49a-5eee45057b7a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:09.594047 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 964/1903] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:09 2021] PUT /identity/v3/projects/ad23dcf3f8674a2091e36238f9226624/users/fa17d0c4d61f4b199984043c5b78ba0c/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:09.598053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19793934-3f34-4e76-8389-c307f8d0c423 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:09.608672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19793934-3f34-4e76-8389-c307f8d0c423 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:09.665830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3841ee-022a-4c98-9ed3-7707a1272b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:09.666503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3841ee-022a-4c98-9ed3-7707a1272b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.666784 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3841ee-022a-4c98-9ed3-7707a1272b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.667059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3841ee-022a-4c98-9ed3-7707a1272b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.667796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3841ee-022a-4c98-9ed3-7707a1272b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:09.669384 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3841ee-022a-4c98-9ed3-7707a1272b70 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:09.679125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 940/1904] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:09 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:09.683398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bff2d-24b1-4dc3-a49a-5eee45057b7a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:09.693875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bff2d-24b1-4dc3-a49a-5eee45057b7a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:09.698697 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54f487-dc2a-4345-b2f1-6b6691c29197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:09.699575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54f487-dc2a-4345-b2f1-6b6691c29197 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.699855 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54f487-dc2a-4345-b2f1-6b6691c29197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.700126 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54f487-dc2a-4345-b2f1-6b6691c29197 admin admin] PATH_INFO: `/v3/projects/ad23dcf3f8674a2091e36238f9226624/users/fa17d0c4d61f4b199984043c5b78ba0c/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.702101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54f487-dc2a-4345-b2f1-6b6691c29197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad23dcf3f8674a2091e36238f9226624, user_id=fa17d0c4d61f4b199984043c5b78ba0c, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:09.704669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54f487-dc2a-4345-b2f1-6b6691c29197 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:09.715739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 965/1905] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:09 2021] PUT /identity/v3/projects/ad23dcf3f8674a2091e36238f9226624/users/fa17d0c4d61f4b199984043c5b78ba0c/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:09.725550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ae039-d186-41e7-9f9c-2038ad62a162 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.725877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ae039-d186-41e7-9f9c-2038ad62a162 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.726161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ae039-d186-41e7-9f9c-2038ad62a162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.753478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-180ae039-d186-41e7-9f9c-2038ad62a162 None None] MFA Rules not processed for user `fa17d0c4d61f4b199984043c5b78ba0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:09.754717 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-180ae039-d186-41e7-9f9c-2038ad62a162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:09.849230 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 941/1906] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:09 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:09.861566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54f487-dc2a-4345-b2f1-6b6691c29197 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:09.863332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1d54f487-dc2a-4345-b2f1-6b6691c29197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:09.920065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54f487-dc2a-4345-b2f1-6b6691c29197 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:09.923819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972078e-fcef-42a7-93b3-67bbc3cba980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:09.924464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972078e-fcef-42a7-93b3-67bbc3cba980 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:09.924747 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972078e-fcef-42a7-93b3-67bbc3cba980 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:09.925024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972078e-fcef-42a7-93b3-67bbc3cba980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:09.979962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972078e-fcef-42a7-93b3-67bbc3cba980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:09.981392 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972078e-fcef-42a7-93b3-67bbc3cba980 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:09.990203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 966/1907] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:09 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:10.914980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ae039-d186-41e7-9f9c-2038ad62a162 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:10.916474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-180ae039-d186-41e7-9f9c-2038ad62a162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:10.981976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ae039-d186-41e7-9f9c-2038ad62a162 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:10.986520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:10.987379 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:10.987659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:10.987931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] PATH_INFO: `/v3/users/395690f930f242b99b4127852f3ee1db` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:10.989121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=395690f930f242b99b4127852f3ee1db)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:10.991060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:11.035961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395690f930f242b99b4127852f3ee1db'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:11.042683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395690f930f242b99b4127852f3ee1db'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:11.049894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395690f930f242b99b4127852f3ee1db'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:11.062192 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395690f930f242b99b4127852f3ee1db'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:11.062938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395690f930f242b99b4127852f3ee1db'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:11.068880 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 942/1908] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:10 2021] DELETE /identity/v3/users/395690f930f242b99b4127852f3ee1db => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:11.074439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4291-561f-4532-981c-575c2e95061c None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:11.074949 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4291-561f-4532-981c-575c2e95061c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:11.075043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4291-561f-4532-981c-575c2e95061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:11.092922 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-7add4291-561f-4532-981c-575c2e95061c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:11.094247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7add4291-561f-4532-981c-575c2e95061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:11.153081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 967/1909] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:11.162937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:11.164611 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:11.227891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e70cb8-6967-4f89-a018-54b6db6626f9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:11.231965 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46d036-741c-4dea-8a11-b0afe818efee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:11.232813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d036-741c-4dea-8a11-b0afe818efee service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:11.233255 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d036-741c-4dea-8a11-b0afe818efee service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:11.233599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d036-741c-4dea-8a11-b0afe818efee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:11.245175 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46d036-741c-4dea-8a11-b0afe818efee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:11.246749 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46d036-741c-4dea-8a11-b0afe818efee service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:11.260795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 943/1910] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:11.657199 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add4291-561f-4532-981c-575c2e95061c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:11.658915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7add4291-561f-4532-981c-575c2e95061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:11.681108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add4291-561f-4532-981c-575c2e95061c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:11.704070 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:11.704845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:11.705117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:11.705392 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] PATH_INFO: `/v3/projects/eb68416ba25142ac8a0145bb0ad8e5a1` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:11.707718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb68416ba25142ac8a0145bb0ad8e5a1)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:11.718890 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:11.829592 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb68416ba25142ac8a0145bb0ad8e5a1', 'request_id': 'req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:11.839653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb68416ba25142ac8a0145bb0ad8e5a1', 'request_id': 'req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:11.853622 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb68416ba25142ac8a0145bb0ad8e5a1', 'request_id': 'req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:11.870232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] The token cache is being invalidate because project eb68416ba25142ac8a0145bb0ad8e5a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:11.870561 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:11.871974 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:11.873879 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 968/1911] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:11 2021] DELETE /identity/v3/projects/eb68416ba25142ac8a0145bb0ad8e5a1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:11.878918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46d036-741c-4dea-8a11-b0afe818efee service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:11.889680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46d036-741c-4dea-8a11-b0afe818efee service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:11.955270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:11.956161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:11.956443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:11.956742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] PATH_INFO: `/v3/users/2093e1202d2343b1b8e11cc5aad30263` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:11.958029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2093e1202d2343b1b8e11cc5aad30263)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:11.969825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:12.024266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2093e1202d2343b1b8e11cc5aad30263'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.031824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2093e1202d2343b1b8e11cc5aad30263'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.040574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2093e1202d2343b1b8e11cc5aad30263'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.057741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2093e1202d2343b1b8e11cc5aad30263'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.058608 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2093e1202d2343b1b8e11cc5aad30263'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.070981 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 944/1912] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:11 2021] DELETE /identity/v3/users/2093e1202d2343b1b8e11cc5aad30263 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:12.364949 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:12.366522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:12.380289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c89ec3-62fc-4bc5-8c18-30db4a68fe5b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:12.437098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:12.437904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:12.438187 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:12.438461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] PATH_INFO: `/v3/projects/677ee0c8e5684ebfbaed3c4b1e12a33e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:12.439672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=677ee0c8e5684ebfbaed3c4b1e12a33e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:12.441560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:12.496227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677ee0c8e5684ebfbaed3c4b1e12a33e', 'request_id': 'req-3c3089af-8772-4f3b-a633-77c3a60b6964'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.500390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677ee0c8e5684ebfbaed3c4b1e12a33e', 'request_id': 'req-3c3089af-8772-4f3b-a633-77c3a60b6964'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.511136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677ee0c8e5684ebfbaed3c4b1e12a33e', 'request_id': 'req-3c3089af-8772-4f3b-a633-77c3a60b6964'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.527209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] The token cache is being invalidate because project 677ee0c8e5684ebfbaed3c4b1e12a33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:12.527906 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.528708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.530595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 969/1913] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:12 2021] DELETE /identity/v3/projects/677ee0c8e5684ebfbaed3c4b1e12a33e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:12.534267 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:12.535710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:12.556504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f524659-8412-4d09-9e42-da52f405db47 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:12.618176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffab8e5-a5de-46a4-84f4-54b03ce9ce25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:12.619065 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab8e5-a5de-46a4-84f4-54b03ce9ce25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:12.619340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab8e5-a5de-46a4-84f4-54b03ce9ce25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:12.619620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab8e5-a5de-46a4-84f4-54b03ce9ce25 admin admin] PATH_INFO: `/v3/users/2da2ffdc4b444c1b857697ac93fc9980` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:12.621144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffab8e5-a5de-46a4-84f4-54b03ce9ce25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da2ffdc4b444c1b857697ac93fc9980)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:12.623429 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffab8e5-a5de-46a4-84f4-54b03ce9ce25 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:12.678135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4ffab8e5-a5de-46a4-84f4-54b03ce9ce25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da2ffdc4b444c1b857697ac93fc9980'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.686184 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4ffab8e5-a5de-46a4-84f4-54b03ce9ce25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da2ffdc4b444c1b857697ac93fc9980'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.694497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4ffab8e5-a5de-46a4-84f4-54b03ce9ce25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da2ffdc4b444c1b857697ac93fc9980'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.707805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4ffab8e5-a5de-46a4-84f4-54b03ce9ce25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da2ffdc4b444c1b857697ac93fc9980'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.708947 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4ffab8e5-a5de-46a4-84f4-54b03ce9ce25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da2ffdc4b444c1b857697ac93fc9980'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.716809 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 945/1914] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:12 2021] DELETE /identity/v3/users/2da2ffdc4b444c1b857697ac93fc9980 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:12.814344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:12.816231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:12.832124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3089af-8772-4f3b-a633-77c3a60b6964 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:12.909399 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:12.910315 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:12.910769 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:12.911050 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] PATH_INFO: `/v3/users/9b9ab3f43c644c43beddbe555865ae96` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:12.913034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9ab3f43c644c43beddbe555865ae96)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:12.915574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:12.982838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9ab3f43c644c43beddbe555865ae96'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.991327 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9ab3f43c644c43beddbe555865ae96'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:12.993112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9ab3f43c644c43beddbe555865ae96'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:13.014162 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9ab3f43c644c43beddbe555865ae96'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:13.015072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9ab3f43c644c43beddbe555865ae96'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:13.053712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 970/1915] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:12 2021] DELETE /identity/v3/users/9b9ab3f43c644c43beddbe555865ae96 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:13.058047 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e308-8e02-4e8d-8223-d63ea6e72095 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.058520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e308-8e02-4e8d-8223-d63ea6e72095 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.058606 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e308-8e02-4e8d-8223-d63ea6e72095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.068607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:13.070764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:13.094969 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-14d3e308-8e02-4e8d-8223-d63ea6e72095 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:13.096213 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-14d3e308-8e02-4e8d-8223-d63ea6e72095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:13.164798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c372bf-fdcb-44a9-914d-e56b03f2f157 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:13.171953 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:13.176139 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 946/1916] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:13.176522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.176522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.176522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] PATH_INFO: `/v3/projects/e678e94c8d47418d94b52cb6be54e3f1` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.176522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e678e94c8d47418d94b52cb6be54e3f1)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:13.178631 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:13.184975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3e308-8e02-4e8d-8223-d63ea6e72095 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:13.186667 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-14d3e308-8e02-4e8d-8223-d63ea6e72095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:13.250488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3e308-8e02-4e8d-8223-d63ea6e72095 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:13.265622 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e678e94c8d47418d94b52cb6be54e3f1', 'request_id': 'req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:13.272140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e678e94c8d47418d94b52cb6be54e3f1', 'request_id': 'req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:13.283441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e678e94c8d47418d94b52cb6be54e3f1', 'request_id': 'req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:13.296290 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] The token cache is being invalidate because project e678e94c8d47418d94b52cb6be54e3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:13.296789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:13.297570 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-503023f7-6b79-4c2f-a06c-fc2a0bf43c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:13.299160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 971/1917] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:13 2021] DELETE /identity/v3/projects/e678e94c8d47418d94b52cb6be54e3f1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:13.307783 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f44f-f023-4462-9282-5a78f97fa711 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.308105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f44f-f023-4462-9282-5a78f97fa711 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.308414 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f44f-f023-4462-9282-5a78f97fa711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.344434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136206f3-b25d-4435-bff5-8eba799c3f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:13.345106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136206f3-b25d-4435-bff5-8eba799c3f73 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.345379 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136206f3-b25d-4435-bff5-8eba799c3f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.345664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136206f3-b25d-4435-bff5-8eba799c3f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.353381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-be24f44f-f023-4462-9282-5a78f97fa711 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:13.354742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-be24f44f-f023-4462-9282-5a78f97fa711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:13.358410 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-136206f3-b25d-4435-bff5-8eba799c3f73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:13.441505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 972/1918] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:13.453016 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b55f-6cc6-4136-af40-bac99023bd89 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.453528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b55f-6cc6-4136-af40-bac99023bd89 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.453832 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b55f-6cc6-4136-af40-bac99023bd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.473262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136206f3-b25d-4435-bff5-8eba799c3f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:13.475118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136206f3-b25d-4435-bff5-8eba799c3f73 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:13.479083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8d49b55f-6cc6-4136-af40-bac99023bd89 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:13.480643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8d49b55f-6cc6-4136-af40-bac99023bd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:13.489943 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 973/1919] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:13.496736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49b55f-6cc6-4136-af40-bac99023bd89 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:13.506468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 947/1920] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:13.528830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49b55f-6cc6-4136-af40-bac99023bd89 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:13.534847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05443c-caba-4daa-bb59-ec36664c5595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:13.535610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05443c-caba-4daa-bb59-ec36664c5595 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.536023 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05443c-caba-4daa-bb59-ec36664c5595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.536298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05443c-caba-4daa-bb59-ec36664c5595 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.537151 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05443c-caba-4daa-bb59-ec36664c5595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:13.537460 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05443c-caba-4daa-bb59-ec36664c5595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:13.540502 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05443c-caba-4daa-bb59-ec36664c5595 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:13.559501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136206f3-b25d-4435-bff5-8eba799c3f73 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:13.564915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 974/1921] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:13.572039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136206f3-b25d-4435-bff5-8eba799c3f73 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:13.577069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8d91d-8a06-4526-9226-c1af3cc3cc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:13.577731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d91d-8a06-4526-9226-c1af3cc3cc68 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.578069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d91d-8a06-4526-9226-c1af3cc3cc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.578325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d91d-8a06-4526-9226-c1af3cc3cc68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.579038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8d91d-8a06-4526-9226-c1af3cc3cc68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:13.580938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8d91d-8a06-4526-9226-c1af3cc3cc68 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:13.612160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 948/1922] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:13 2021] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:37:13.620572 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05443c-caba-4daa-bb59-ec36664c5595 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:13.635553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05443c-caba-4daa-bb59-ec36664c5595 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:13.734797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd808b-967d-4ee8-bedc-ba7897059648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:13.735711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd808b-967d-4ee8-bedc-ba7897059648 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.736233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd808b-967d-4ee8-bedc-ba7897059648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.736677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd808b-967d-4ee8-bedc-ba7897059648 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.738252 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd808b-967d-4ee8-bedc-ba7897059648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:13.739633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd808b-967d-4ee8-bedc-ba7897059648 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:13.762648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 975/1923] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:13 2021] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:13.765544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8d91d-8a06-4526-9226-c1af3cc3cc68 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:13.780590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8d91d-8a06-4526-9226-c1af3cc3cc68 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:13.788556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b77f3-8a09-4aa5-9836-28212e7deee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:13.789653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b77f3-8a09-4aa5-9836-28212e7deee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.790183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b77f3-8a09-4aa5-9836-28212e7deee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.790828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b77f3-8a09-4aa5-9836-28212e7deee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.791929 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b77f3-8a09-4aa5-9836-28212e7deee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:13.793731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b77f3-8a09-4aa5-9836-28212e7deee5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:13.810909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 949/1924] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:13 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:13.814963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd808b-967d-4ee8-bedc-ba7897059648 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:13.831602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd808b-967d-4ee8-bedc-ba7897059648 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:13.839253 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a127431-d2d8-4357-ac77-9dfc23b68108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:13.839942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127431-d2d8-4357-ac77-9dfc23b68108 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.840237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127431-d2d8-4357-ac77-9dfc23b68108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.840532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127431-d2d8-4357-ac77-9dfc23b68108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.841944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a127431-d2d8-4357-ac77-9dfc23b68108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:13.843022 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a127431-d2d8-4357-ac77-9dfc23b68108 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:13.856913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 976/1925] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:13 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:13.858222 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b77f3-8a09-4aa5-9836-28212e7deee5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:13.869689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b77f3-8a09-4aa5-9836-28212e7deee5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:13.875739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93f4ef-7377-4bcc-b96b-4a4692d6cb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:13.878298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93f4ef-7377-4bcc-b96b-4a4692d6cb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.878655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93f4ef-7377-4bcc-b96b-4a4692d6cb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.878999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93f4ef-7377-4bcc-b96b-4a4692d6cb70 admin admin] PATH_INFO: `/v3/projects/caacfe36d68f48a5ba440f700c2fd386/users/6574a1b302b94e98b111104e09ab0299/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.901276 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93f4ef-7377-4bcc-b96b-4a4692d6cb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caacfe36d68f48a5ba440f700c2fd386, user_id=6574a1b302b94e98b111104e09ab0299, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:13.904073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93f4ef-7377-4bcc-b96b-4a4692d6cb70 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:13.930840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 950/1926] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:13 2021] PUT /identity/v3/projects/caacfe36d68f48a5ba440f700c2fd386/users/6574a1b302b94e98b111104e09ab0299/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:13.942052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ac9b2-a56c-49dd-8995-fc4f26dbce14 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:13.942340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ac9b2-a56c-49dd-8995-fc4f26dbce14 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:13.942620 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ac9b2-a56c-49dd-8995-fc4f26dbce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:13.972804 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-fa3ac9b2-a56c-49dd-8995-fc4f26dbce14 None None] MFA Rules not processed for user `6574a1b302b94e98b111104e09ab0299`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:13.974078 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-fa3ac9b2-a56c-49dd-8995-fc4f26dbce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:14.060470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 977/1927] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:13 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:14.070445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93f4ef-7377-4bcc-b96b-4a4692d6cb70 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:14.073106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8e93f4ef-7377-4bcc-b96b-4a4692d6cb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:14.138743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93f4ef-7377-4bcc-b96b-4a4692d6cb70 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:14.145095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4842c67-5d1b-4145-8352-79c779c845dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:14.146551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842c67-5d1b-4145-8352-79c779c845dd service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:14.146918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842c67-5d1b-4145-8352-79c779c845dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:14.147377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842c67-5d1b-4145-8352-79c779c845dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:14.160760 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4842c67-5d1b-4145-8352-79c779c845dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:14.162500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4842c67-5d1b-4145-8352-79c779c845dd service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:14.173290 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 951/1928] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:14 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:14.192651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ac9b2-a56c-49dd-8995-fc4f26dbce14 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:14.258816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ac9b2-a56c-49dd-8995-fc4f26dbce14 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:14.263378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:14.264186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:14.264465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:14.264740 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] PATH_INFO: `/v3/users/6574a1b302b94e98b111104e09ab0299` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:14.266009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6574a1b302b94e98b111104e09ab0299)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:14.268022 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:14.318488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6574a1b302b94e98b111104e09ab0299'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.327071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6574a1b302b94e98b111104e09ab0299'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.328393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6574a1b302b94e98b111104e09ab0299'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.340902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6574a1b302b94e98b111104e09ab0299'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.341599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6574a1b302b94e98b111104e09ab0299'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.357273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 978/1929] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:14 2021] DELETE /identity/v3/users/6574a1b302b94e98b111104e09ab0299 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:14.361885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38d1d5-f56c-4bce-8e80-d2eeab92130b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:14.362177 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38d1d5-f56c-4bce-8e80-d2eeab92130b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:14.362455 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38d1d5-f56c-4bce-8e80-d2eeab92130b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:14.379668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-ed38d1d5-f56c-4bce-8e80-d2eeab92130b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:14.380874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ed38d1d5-f56c-4bce-8e80-d2eeab92130b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:14.439853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 952/1930] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:14.450920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:14.452472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:14.514169 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013cd4e-eaaa-4555-a966-9640b9666da1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:14.517743 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95bce5-9eb8-4a7d-8c15-f4874a400a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:14.518420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95bce5-9eb8-4a7d-8c15-f4874a400a6a service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:14.518703 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95bce5-9eb8-4a7d-8c15-f4874a400a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:14.518984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95bce5-9eb8-4a7d-8c15-f4874a400a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:14.529697 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95bce5-9eb8-4a7d-8c15-f4874a400a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:14.531155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95bce5-9eb8-4a7d-8c15-f4874a400a6a service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:14.542831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 979/1931] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:14.649490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38d1d5-f56c-4bce-8e80-d2eeab92130b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:14.651013 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ed38d1d5-f56c-4bce-8e80-d2eeab92130b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:14.665034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38d1d5-f56c-4bce-8e80-d2eeab92130b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:14.673821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:14.674761 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:14.675194 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:14.675686 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] PATH_INFO: `/v3/projects/105097d4947f4140bb239dbca0de6e99` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:14.677828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] RBAC: Authorizing `identity:delete_project(project_id=105097d4947f4140bb239dbca0de6e99)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:14.682274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:14.741871 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105097d4947f4140bb239dbca0de6e99', 'request_id': 'req-292a5a0d-806c-4421-a415-962b7a52039c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.751280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105097d4947f4140bb239dbca0de6e99', 'request_id': 'req-292a5a0d-806c-4421-a415-962b7a52039c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.760097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105097d4947f4140bb239dbca0de6e99', 'request_id': 'req-292a5a0d-806c-4421-a415-962b7a52039c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.772373 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] The token cache is being invalidate because project 105097d4947f4140bb239dbca0de6e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:14.772667 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.773621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.778044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 953/1932] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:14 2021] DELETE /identity/v3/projects/105097d4947f4140bb239dbca0de6e99 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:14.779549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95bce5-9eb8-4a7d-8c15-f4874a400a6a service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:14.792400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95bce5-9eb8-4a7d-8c15-f4874a400a6a service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:14.860422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5a5c7-6eae-4ca7-a1d9-47d8ced6808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:14.861294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a5c7-6eae-4ca7-a1d9-47d8ced6808e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:14.861581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a5c7-6eae-4ca7-a1d9-47d8ced6808e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:14.861898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a5c7-6eae-4ca7-a1d9-47d8ced6808e admin admin] PATH_INFO: `/v3/users/fa17d0c4d61f4b199984043c5b78ba0c` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:14.863192 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5a5c7-6eae-4ca7-a1d9-47d8ced6808e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa17d0c4d61f4b199984043c5b78ba0c)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:14.865157 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5a5c7-6eae-4ca7-a1d9-47d8ced6808e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:14.916300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:14.918048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:14.953999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a5a0d-806c-4421-a415-962b7a52039c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:14.963087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ccf5a5c7-6eae-4ca7-a1d9-47d8ced6808e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa17d0c4d61f4b199984043c5b78ba0c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.964040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:14.964957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:14.965388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:14.966299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] PATH_INFO: `/v3/projects/caacfe36d68f48a5ba440f700c2fd386` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:14.967641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caacfe36d68f48a5ba440f700c2fd386)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:14.970904 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:14.977680 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ccf5a5c7-6eae-4ca7-a1d9-47d8ced6808e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa17d0c4d61f4b199984043c5b78ba0c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.978869 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ccf5a5c7-6eae-4ca7-a1d9-47d8ced6808e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa17d0c4d61f4b199984043c5b78ba0c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.991345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ccf5a5c7-6eae-4ca7-a1d9-47d8ced6808e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa17d0c4d61f4b199984043c5b78ba0c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:14.992837 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ccf5a5c7-6eae-4ca7-a1d9-47d8ced6808e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa17d0c4d61f4b199984043c5b78ba0c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:15.012500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 980/1933] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:14 2021] DELETE /identity/v3/users/fa17d0c4d61f4b199984043c5b78ba0c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:15.035001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caacfe36d68f48a5ba440f700c2fd386', 'request_id': 'req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:15.043839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caacfe36d68f48a5ba440f700c2fd386', 'request_id': 'req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:15.052720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caacfe36d68f48a5ba440f700c2fd386', 'request_id': 'req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:15.064341 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] The token cache is being invalidate because project caacfe36d68f48a5ba440f700c2fd386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:15.064674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:15.065313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b52583d-b2ea-4e0a-a262-f1dc2275eaa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:15.068323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 954/1934] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:14 2021] DELETE /identity/v3/projects/caacfe36d68f48a5ba440f700c2fd386 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:15.075101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c728b-8441-4f5f-a76e-bda294428a5c None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.075388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c728b-8441-4f5f-a76e-bda294428a5c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.075700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c728b-8441-4f5f-a76e-bda294428a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.131677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-db8c728b-8441-4f5f-a76e-bda294428a5c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:15.144651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-db8c728b-8441-4f5f-a76e-bda294428a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:15.311546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 981/1935] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:15.319336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a1d9-64ac-492e-a6ff-56ebbce2ec76 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.319863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a1d9-64ac-492e-a6ff-56ebbce2ec76 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.319863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a1d9-64ac-492e-a6ff-56ebbce2ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.343943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-2b60a1d9-64ac-492e-a6ff-56ebbce2ec76 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:15.345157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2b60a1d9-64ac-492e-a6ff-56ebbce2ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:15.353684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 955/1936] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:15.358031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c728b-8441-4f5f-a76e-bda294428a5c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:15.369150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c728b-8441-4f5f-a76e-bda294428a5c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:15.374145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2ab5f-7f00-4d61-9d46-dad161080982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:15.374893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2ab5f-7f00-4d61-9d46-dad161080982 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.375302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2ab5f-7f00-4d61-9d46-dad161080982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.375585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2ab5f-7f00-4d61-9d46-dad161080982 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.376332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2ab5f-7f00-4d61-9d46-dad161080982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:15.376640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2ab5f-7f00-4d61-9d46-dad161080982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:15.378416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2ab5f-7f00-4d61-9d46-dad161080982 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:15.392420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 982/1937] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:15.396945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60a1d9-64ac-492e-a6ff-56ebbce2ec76 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:15.406343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60a1d9-64ac-492e-a6ff-56ebbce2ec76 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:15.411394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e118c-d0c7-4e1b-bf6b-6bb33706aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:15.412150 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e118c-d0c7-4e1b-bf6b-6bb33706aa70 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.412496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e118c-d0c7-4e1b-bf6b-6bb33706aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.413126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e118c-d0c7-4e1b-bf6b-6bb33706aa70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.414386 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e118c-d0c7-4e1b-bf6b-6bb33706aa70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:15.416362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e118c-d0c7-4e1b-bf6b-6bb33706aa70 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:15.450249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 956/1938] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:15 2021] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:37:15.451198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2ab5f-7f00-4d61-9d46-dad161080982 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:15.455239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e118c-d0c7-4e1b-bf6b-6bb33706aa70 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:15.457196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-dc7e118c-d0c7-4e1b-bf6b-6bb33706aa70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:15.465098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2ab5f-7f00-4d61-9d46-dad161080982 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:15.543129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e118c-d0c7-4e1b-bf6b-6bb33706aa70 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:15.552571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:15.553442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.553724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.554000 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] PATH_INFO: `/v3/projects/ad23dcf3f8674a2091e36238f9226624` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.555818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad23dcf3f8674a2091e36238f9226624)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:15.557820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:15.561999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f4d4d-bd12-4482-bcab-73d9a8f35f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:15.562947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f4d4d-bd12-4482-bcab-73d9a8f35f9e admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.562947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f4d4d-bd12-4482-bcab-73d9a8f35f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.563234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f4d4d-bd12-4482-bcab-73d9a8f35f9e admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.565313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f4d4d-bd12-4482-bcab-73d9a8f35f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:15.566522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f4d4d-bd12-4482-bcab-73d9a8f35f9e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:15.599223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 983/1939] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:15 2021] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:15.604212 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f4d4d-bd12-4482-bcab-73d9a8f35f9e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:15.621218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f4d4d-bd12-4482-bcab-73d9a8f35f9e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:15.637306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d269f6-2c3f-4538-803c-6eb18c089d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:15.639749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d269f6-2c3f-4538-803c-6eb18c089d32 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.641128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d269f6-2c3f-4538-803c-6eb18c089d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.641499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d269f6-2c3f-4538-803c-6eb18c089d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.643231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d269f6-2c3f-4538-803c-6eb18c089d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:15.647553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d269f6-2c3f-4538-803c-6eb18c089d32 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:15.679197 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 984/1940] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:15 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:15.679876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad23dcf3f8674a2091e36238f9226624', 'request_id': 'req-edf18262-894b-409a-9985-e687c4a460da'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:15.682228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d269f6-2c3f-4538-803c-6eb18c089d32 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:15.695082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d269f6-2c3f-4538-803c-6eb18c089d32 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:15.698108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad23dcf3f8674a2091e36238f9226624', 'request_id': 'req-edf18262-894b-409a-9985-e687c4a460da'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:15.715308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad23dcf3f8674a2091e36238f9226624', 'request_id': 'req-edf18262-894b-409a-9985-e687c4a460da'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:15.742595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] The token cache is being invalidate because project ad23dcf3f8674a2091e36238f9226624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:15.742595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:15.744296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-edf18262-894b-409a-9985-e687c4a460da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:15.748084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 957/1941] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:15 2021] DELETE /identity/v3/projects/ad23dcf3f8674a2091e36238f9226624 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:15.757152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd5d6-03a5-467a-a9b8-bb8d42f870b7 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.757434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd5d6-03a5-467a-a9b8-bb8d42f870b7 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.758347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd5d6-03a5-467a-a9b8-bb8d42f870b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.786387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-0a4fd5d6-03a5-467a-a9b8-bb8d42f870b7 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:15.788926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0a4fd5d6-03a5-467a-a9b8-bb8d42f870b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:15.821646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3138f2-915f-4030-969f-5e701c37571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:15.823027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3138f2-915f-4030-969f-5e701c37571a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.824121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3138f2-915f-4030-969f-5e701c37571a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.824830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3138f2-915f-4030-969f-5e701c37571a admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.826396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3138f2-915f-4030-969f-5e701c37571a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:15.829494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3138f2-915f-4030-969f-5e701c37571a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:15.845209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 985/1942] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:15 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:15.849340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3138f2-915f-4030-969f-5e701c37571a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:15.854703 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-aa3138f2-915f-4030-969f-5e701c37571a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:15.871638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3138f2-915f-4030-969f-5e701c37571a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:15.877533 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed45e60-fa6e-479e-8feb-10efc794a214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:15.878583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45e60-fa6e-479e-8feb-10efc794a214 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.879048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45e60-fa6e-479e-8feb-10efc794a214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.879395 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45e60-fa6e-479e-8feb-10efc794a214 admin admin] PATH_INFO: `/v3/projects/d24079f24de24b808b620d5173ebdf5c/users/3a588d55a67e49cb9e5836db10ad5f62/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.900287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed45e60-fa6e-479e-8feb-10efc794a214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24079f24de24b808b620d5173ebdf5c, user_id=3a588d55a67e49cb9e5836db10ad5f62, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:15.903996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed45e60-fa6e-479e-8feb-10efc794a214 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:15.930453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 986/1943] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:15 2021] PUT /identity/v3/projects/d24079f24de24b808b620d5173ebdf5c/users/3a588d55a67e49cb9e5836db10ad5f62/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:15.941483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 958/1944] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:15.952340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce929e-8a1a-4091-9210-dc945c26bd22 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.952340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce929e-8a1a-4091-9210-dc945c26bd22 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.952340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce929e-8a1a-4091-9210-dc945c26bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.962036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324e19-e123-4c02-9677-d7697328d7cd None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:15.962036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324e19-e123-4c02-9677-d7697328d7cd None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:15.962036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324e19-e123-4c02-9677-d7697328d7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:15.999584 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-96ce929e-8a1a-4091-9210-dc945c26bd22 None None] MFA Rules not processed for user `3a588d55a67e49cb9e5836db10ad5f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:16.000845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-96ce929e-8a1a-4091-9210-dc945c26bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:16.002797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-47324e19-e123-4c02-9677-d7697328d7cd None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:16.004433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-47324e19-e123-4c02-9677-d7697328d7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:16.113489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 959/1945] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Dec 15 13:37:16.118742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324e19-e123-4c02-9677-d7697328d7cd None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:16.135560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324e19-e123-4c02-9677-d7697328d7cd None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:16.148940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 987/1946] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:15 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:16.157999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109a887-df2d-456f-8468-b65506bd3e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:16.159008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109a887-df2d-456f-8468-b65506bd3e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:16.159140 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109a887-df2d-456f-8468-b65506bd3e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:16.160003 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce929e-8a1a-4091-9210-dc945c26bd22 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:16.160267 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109a887-df2d-456f-8468-b65506bd3e1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:16.161517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-96ce929e-8a1a-4091-9210-dc945c26bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:16.162742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109a887-df2d-456f-8468-b65506bd3e1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:16.163057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109a887-df2d-456f-8468-b65506bd3e1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:16.166963 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109a887-df2d-456f-8468-b65506bd3e1b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:16.199824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 960/1947] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:16.204868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109a887-df2d-456f-8468-b65506bd3e1b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:16.229490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109a887-df2d-456f-8468-b65506bd3e1b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:16.241966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a02a9-ab8c-4c5a-968d-d0e179d497f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:16.244174 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a02a9-ab8c-4c5a-968d-d0e179d497f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:16.244469 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a02a9-ab8c-4c5a-968d-d0e179d497f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:16.244721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a02a9-ab8c-4c5a-968d-d0e179d497f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:16.248221 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a02a9-ab8c-4c5a-968d-d0e179d497f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:16.253600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a02a9-ab8c-4c5a-968d-d0e179d497f7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:16.293982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce929e-8a1a-4091-9210-dc945c26bd22 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:16.299689 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54183e7-e535-4efc-a6a3-ba5444246333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:16.300579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54183e7-e535-4efc-a6a3-ba5444246333 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:16.300907 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54183e7-e535-4efc-a6a3-ba5444246333 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:16.301210 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54183e7-e535-4efc-a6a3-ba5444246333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:16.315447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 961/1948] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:16 2021] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:16.320527 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a02a9-ab8c-4c5a-968d-d0e179d497f7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:16.328568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54183e7-e535-4efc-a6a3-ba5444246333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:16.334108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54183e7-e535-4efc-a6a3-ba5444246333 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:16.361571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 988/1949] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:16 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:16.488398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a02a9-ab8c-4c5a-968d-d0e179d497f7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:16.504706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266824b9-b89d-4abd-84bf-d3caaf0acc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:16.505822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266824b9-b89d-4abd-84bf-d3caaf0acc68 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:16.506292 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266824b9-b89d-4abd-84bf-d3caaf0acc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:16.506735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266824b9-b89d-4abd-84bf-d3caaf0acc68 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:16.507602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266824b9-b89d-4abd-84bf-d3caaf0acc68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:16.514782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266824b9-b89d-4abd-84bf-d3caaf0acc68 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:16.555051 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 962/1950] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:16 2021] POST /identity/v3/users => generated 295 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:16.560608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54183e7-e535-4efc-a6a3-ba5444246333 service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:16.573554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54183e7-e535-4efc-a6a3-ba5444246333 service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:16.587535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a99f2-c015-4e5e-8ea3-83faf53f3fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:16.588237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a99f2-c015-4e5e-8ea3-83faf53f3fef admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:16.588519 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a99f2-c015-4e5e-8ea3-83faf53f3fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:16.589509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a99f2-c015-4e5e-8ea3-83faf53f3fef admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:16.593006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a99f2-c015-4e5e-8ea3-83faf53f3fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:16.593452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a99f2-c015-4e5e-8ea3-83faf53f3fef admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:16.616070 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 989/1951] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:16 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:16.621207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266824b9-b89d-4abd-84bf-d3caaf0acc68 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:16.637805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266824b9-b89d-4abd-84bf-d3caaf0acc68 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:16.643038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008a206-6d64-4bc1-8b96-7be863f9ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:16.643839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008a206-6d64-4bc1-8b96-7be863f9ddce admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:16.644217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008a206-6d64-4bc1-8b96-7be863f9ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:16.644584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008a206-6d64-4bc1-8b96-7be863f9ddce admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:16.645528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008a206-6d64-4bc1-8b96-7be863f9ddce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:16.647289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008a206-6d64-4bc1-8b96-7be863f9ddce admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:16.662961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 963/1952] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:16 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:16.667690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a99f2-c015-4e5e-8ea3-83faf53f3fef admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:16.680776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a99f2-c015-4e5e-8ea3-83faf53f3fef admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:16.688172 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb9801-e874-4960-af10-59d0a7a5c92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:16.689551 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb9801-e874-4960-af10-59d0a7a5c92c admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:16.690021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb9801-e874-4960-af10-59d0a7a5c92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:16.690458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb9801-e874-4960-af10-59d0a7a5c92c admin admin] PATH_INFO: `/v3/projects/c875e932f33f4dada66d8d6bec6eafb5/users/ef9b0a4b7e2a42518d3e358fe82cef16/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:16.711995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb9801-e874-4960-af10-59d0a7a5c92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c875e932f33f4dada66d8d6bec6eafb5, user_id=ef9b0a4b7e2a42518d3e358fe82cef16, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:16.715531 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb9801-e874-4960-af10-59d0a7a5c92c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:16.739030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 990/1953] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:16 2021] PUT /identity/v3/projects/c875e932f33f4dada66d8d6bec6eafb5/users/ef9b0a4b7e2a42518d3e358fe82cef16/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:16.751453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33dd45-bdba-487a-ba19-790ed6eda747 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:16.751760 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33dd45-bdba-487a-ba19-790ed6eda747 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:16.752169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33dd45-bdba-487a-ba19-790ed6eda747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:16.813857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-0d33dd45-bdba-487a-ba19-790ed6eda747 None None] MFA Rules not processed for user `ef9b0a4b7e2a42518d3e358fe82cef16`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:16.816490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0d33dd45-bdba-487a-ba19-790ed6eda747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:16.986575 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 964/1954] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:16 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:17.174927 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb9801-e874-4960-af10-59d0a7a5c92c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:17.177828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-07cb9801-e874-4960-af10-59d0a7a5c92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:17.267578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb9801-e874-4960-af10-59d0a7a5c92c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:17.272806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c8a6b-79ba-444b-a090-c3e17cb7dad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:17.274601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c8a6b-79ba-444b-a090-c3e17cb7dad7 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:17.275146 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c8a6b-79ba-444b-a090-c3e17cb7dad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:17.275442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c8a6b-79ba-444b-a090-c3e17cb7dad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:17.289942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c8a6b-79ba-444b-a090-c3e17cb7dad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:17.291392 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c8a6b-79ba-444b-a090-c3e17cb7dad7 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:17.300965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 991/1955] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:17 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:40.030773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33dd45-bdba-487a-ba19-790ed6eda747 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:40.129361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33dd45-bdba-487a-ba19-790ed6eda747 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:40.142161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:40.142161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:40.142161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:40.142161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] PATH_INFO: `/v3/users/3a588d55a67e49cb9e5836db10ad5f62` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:40.142530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a588d55a67e49cb9e5836db10ad5f62)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:40.145239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:40.218431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a588d55a67e49cb9e5836db10ad5f62'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:40.225408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a588d55a67e49cb9e5836db10ad5f62'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:40.235153 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a588d55a67e49cb9e5836db10ad5f62'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:40.247988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a588d55a67e49cb9e5836db10ad5f62'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:40.248782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a588d55a67e49cb9e5836db10ad5f62'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:40.254953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 965/1956] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:40 2021] DELETE /identity/v3/users/3a588d55a67e49cb9e5836db10ad5f62 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:40.259987 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372514c-d8ae-46ae-818a-ea08ddade262 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:40.260537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372514c-d8ae-46ae-818a-ea08ddade262 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:40.260690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372514c-d8ae-46ae-818a-ea08ddade262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:40.282015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2372514c-d8ae-46ae-818a-ea08ddade262 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:40.283228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2372514c-d8ae-46ae-818a-ea08ddade262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:40.300921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:40.302550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:40.365143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 992/1957] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:40.377055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372514c-d8ae-46ae-818a-ea08ddade262 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:40.380428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2372514c-d8ae-46ae-818a-ea08ddade262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:40.413914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783fb76-38c0-4fc4-9445-f08f3a0ca527 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:40.420724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:40.422087 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:40.422505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:40.422823 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] PATH_INFO: `/v3/users/6162b9a641804f898d4971cd94006717` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:40.424305 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6162b9a641804f898d4971cd94006717)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:40.427103 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:40.454712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372514c-d8ae-46ae-818a-ea08ddade262 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:40.464851 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb8694-ec32-46d7-8da0-bf8d896cbf6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:40.465725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb8694-ec32-46d7-8da0-bf8d896cbf6e service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:40.466487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb8694-ec32-46d7-8da0-bf8d896cbf6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:40.466987 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb8694-ec32-46d7-8da0-bf8d896cbf6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:40.483570 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb8694-ec32-46d7-8da0-bf8d896cbf6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:40.485095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb8694-ec32-46d7-8da0-bf8d896cbf6e service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:40.491633 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6162b9a641804f898d4971cd94006717'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:40.501352 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6162b9a641804f898d4971cd94006717'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:40.512682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 993/1958] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:40.513815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6162b9a641804f898d4971cd94006717'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:40.528920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6162b9a641804f898d4971cd94006717'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:40.529682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6162b9a641804f898d4971cd94006717'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:40.542721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 966/1959] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:40 2021] DELETE /identity/v3/users/6162b9a641804f898d4971cd94006717 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:40.544596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47dd7f-bc75-425e-828f-6c390db4c26d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:40.544957 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47dd7f-bc75-425e-828f-6c390db4c26d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:40.545303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47dd7f-bc75-425e-828f-6c390db4c26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:40.566833 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5c47dd7f-bc75-425e-828f-6c390db4c26d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:40.568712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5c47dd7f-bc75-425e-828f-6c390db4c26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:40.697158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 994/1960] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:40.706781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:40.708545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:40.811528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20f2bc-929a-43da-bf84-67d936b4a977 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:40.816791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d6b5f-f087-4f99-894f-de6da72e889b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:40.817728 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d6b5f-f087-4f99-894f-de6da72e889b service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:40.818537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d6b5f-f087-4f99-894f-de6da72e889b service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:40.818995 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d6b5f-f087-4f99-894f-de6da72e889b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:40.835099 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d6b5f-f087-4f99-894f-de6da72e889b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:40.836625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d6b5f-f087-4f99-894f-de6da72e889b service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:40.850564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 967/1961] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:40.891998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47dd7f-bc75-425e-828f-6c390db4c26d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:40.893460 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5c47dd7f-bc75-425e-828f-6c390db4c26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:40.905808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47dd7f-bc75-425e-828f-6c390db4c26d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:40.910621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:40.911490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:40.911821 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:40.912032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] PATH_INFO: `/v3/projects/d24079f24de24b808b620d5173ebdf5c` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:40.913231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24079f24de24b808b620d5173ebdf5c)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:40.915695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:40.987806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24079f24de24b808b620d5173ebdf5c', 'request_id': 'req-46baef59-e684-4baf-a5ba-4c8bed51ab98'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:40.996356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24079f24de24b808b620d5173ebdf5c', 'request_id': 'req-46baef59-e684-4baf-a5ba-4c8bed51ab98'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.008215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24079f24de24b808b620d5173ebdf5c', 'request_id': 'req-46baef59-e684-4baf-a5ba-4c8bed51ab98'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.022037 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] The token cache is being invalidate because project d24079f24de24b808b620d5173ebdf5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:41.022353 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.023021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46baef59-e684-4baf-a5ba-4c8bed51ab98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.025065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 995/1962] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:40 2021] DELETE /identity/v3/projects/d24079f24de24b808b620d5173ebdf5c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:41.033625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f5280-07fe-41de-a589-3d6aa867e2a0 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.035336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f5280-07fe-41de-a589-3d6aa867e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.036334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f5280-07fe-41de-a589-3d6aa867e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.075964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-265f5280-07fe-41de-a589-3d6aa867e2a0 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:41.077288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-265f5280-07fe-41de-a589-3d6aa867e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:41.162220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 968/1963] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:41.171084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47185-2d66-4664-9a7b-607609b1ecce None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.171376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47185-2d66-4664-9a7b-607609b1ecce None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.171664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47185-2d66-4664-9a7b-607609b1ecce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.190735 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-f9e47185-2d66-4664-9a7b-607609b1ecce None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:41.192058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f9e47185-2d66-4664-9a7b-607609b1ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:41.205325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f5280-07fe-41de-a589-3d6aa867e2a0 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:41.213163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 996/1964] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:41.217424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f5280-07fe-41de-a589-3d6aa867e2a0 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:41.225335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab839e0-f585-416e-b7fa-8138fa1a77d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:41.226595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab839e0-f585-416e-b7fa-8138fa1a77d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.227654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab839e0-f585-416e-b7fa-8138fa1a77d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.228491 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab839e0-f585-416e-b7fa-8138fa1a77d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.229492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab839e0-f585-416e-b7fa-8138fa1a77d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:41.230078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab839e0-f585-416e-b7fa-8138fa1a77d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:41.231936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab839e0-f585-416e-b7fa-8138fa1a77d1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:41.255705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 969/1965] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:41.260332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e47185-2d66-4664-9a7b-607609b1ecce None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:41.270390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e47185-2d66-4664-9a7b-607609b1ecce None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:41.276206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517e9cc-fcad-4f3c-b630-7d47f7364565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:41.276894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517e9cc-fcad-4f3c-b630-7d47f7364565 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.277350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517e9cc-fcad-4f3c-b630-7d47f7364565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.277636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517e9cc-fcad-4f3c-b630-7d47f7364565 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.278390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517e9cc-fcad-4f3c-b630-7d47f7364565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:41.280466 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517e9cc-fcad-4f3c-b630-7d47f7364565 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:41.329982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 997/1966] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:41 2021] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:41.334412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab839e0-f585-416e-b7fa-8138fa1a77d1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:41.346333 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab839e0-f585-416e-b7fa-8138fa1a77d1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:41.423864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9ac74-8460-4bc4-8537-d4a8edd4641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:41.424573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517e9cc-fcad-4f3c-b630-7d47f7364565 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:41.424735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9ac74-8460-4bc4-8537-d4a8edd4641e admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.425083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9ac74-8460-4bc4-8537-d4a8edd4641e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.425424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9ac74-8460-4bc4-8537-d4a8edd4641e admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.426279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9ac74-8460-4bc4-8537-d4a8edd4641e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:41.427240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7517e9cc-fcad-4f3c-b630-7d47f7364565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:41.428884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9ac74-8460-4bc4-8537-d4a8edd4641e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:41.446571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517e9cc-fcad-4f3c-b630-7d47f7364565 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:41.454693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:41.456148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.456464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.456860 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 970/1967] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:41 2021] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:41.460201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] PATH_INFO: `/v3/projects/25f2e50e7e8043f2bf9e8a68b5c2a7b5` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.460876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9ac74-8460-4bc4-8537-d4a8edd4641e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:41.462142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f2e50e7e8043f2bf9e8a68b5c2a7b5)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:41.464069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:41.472707 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9ac74-8460-4bc4-8537-d4a8edd4641e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:41.478193 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc3348-b709-46af-a2df-945bc710337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:41.478939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc3348-b709-46af-a2df-945bc710337d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.479289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc3348-b709-46af-a2df-945bc710337d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.479637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc3348-b709-46af-a2df-945bc710337d admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.480447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc3348-b709-46af-a2df-945bc710337d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:41.482778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc3348-b709-46af-a2df-945bc710337d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:41.495027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 971/1968] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:41.499232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc3348-b709-46af-a2df-945bc710337d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:41.510025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc3348-b709-46af-a2df-945bc710337d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:41.527068 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f2e50e7e8043f2bf9e8a68b5c2a7b5', 'request_id': 'req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.540356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f2e50e7e8043f2bf9e8a68b5c2a7b5', 'request_id': 'req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.550782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f2e50e7e8043f2bf9e8a68b5c2a7b5', 'request_id': 'req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.562166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] The token cache is being invalidate because project 25f2e50e7e8043f2bf9e8a68b5c2a7b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:41.562600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.563465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.565976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 998/1969] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:41 2021] DELETE /identity/v3/projects/25f2e50e7e8043f2bf9e8a68b5c2a7b5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:41.569275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:41.571358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:41.578320 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245b517-daed-43a8-a759-ebc86ace02b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:41.579085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b517-daed-43a8-a759-ebc86ace02b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.579442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b517-daed-43a8-a759-ebc86ace02b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.579787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b517-daed-43a8-a759-ebc86ace02b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.580602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245b517-daed-43a8-a759-ebc86ace02b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:41.582478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245b517-daed-43a8-a759-ebc86ace02b8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:41.593687 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 972/1970] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:41.598025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245b517-daed-43a8-a759-ebc86ace02b8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:41.599950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7245b517-daed-43a8-a759-ebc86ace02b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:41.613059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245b517-daed-43a8-a759-ebc86ace02b8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:41.619335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7723a-dbf8-45c7-b480-3a95210ab999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:41.620426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7723a-dbf8-45c7-b480-3a95210ab999 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.620882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7723a-dbf8-45c7-b480-3a95210ab999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.621302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7723a-dbf8-45c7-b480-3a95210ab999 admin admin] PATH_INFO: `/v3/projects/b3823701b6f1423aa1ecd29bf162e5db/users/66780c2cebcd40cfa78589c9b4cd4622/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.640000 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7723a-dbf8-45c7-b480-3a95210ab999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3823701b6f1423aa1ecd29bf162e5db, user_id=66780c2cebcd40cfa78589c9b4cd4622, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:41.642740 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7723a-dbf8-45c7-b480-3a95210ab999 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:41.659294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e8e8b-ff18-4986-ab2a-d979a2dd9eb6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:41.661393 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 973/1971] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:41 2021] PUT /identity/v3/projects/b3823701b6f1423aa1ecd29bf162e5db/users/66780c2cebcd40cfa78589c9b4cd4622/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:41.667462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9e2e6-bd16-4a2d-9431-40e9f2a88e95 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.667808 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9e2e6-bd16-4a2d-9431-40e9f2a88e95 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.668641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9e2e6-bd16-4a2d-9431-40e9f2a88e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.697653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c4c9e2e6-bd16-4a2d-9431-40e9f2a88e95 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:41.704853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c4c9e2e6-bd16-4a2d-9431-40e9f2a88e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:41.765887 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:41.767014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.767540 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.767960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] PATH_INFO: `/v3/users/de48470bf8704989a2877757d18da689` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.769407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de48470bf8704989a2877757d18da689)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:41.771656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:41.791945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 974/1972] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:41.806725 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9e2e6-bd16-4a2d-9431-40e9f2a88e95 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:41.808280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c4c9e2e6-bd16-4a2d-9431-40e9f2a88e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:41.858270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de48470bf8704989a2877757d18da689'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.865598 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de48470bf8704989a2877757d18da689'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.867274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de48470bf8704989a2877757d18da689'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.886881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de48470bf8704989a2877757d18da689'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.887645 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de48470bf8704989a2877757d18da689'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:41.891839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9e2e6-bd16-4a2d-9431-40e9f2a88e95 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:41.896305 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a9d6c-9140-4de0-a720-64264cf99ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:41.897121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a9d6c-9140-4de0-a720-64264cf99ecb service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:41.897264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a9d6c-9140-4de0-a720-64264cf99ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:41.897537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a9d6c-9140-4de0-a720-64264cf99ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:41.900012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4c9a9d6c-9140-4de0-a720-64264cf99ecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:41.903599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 999/1973] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:41 2021] DELETE /identity/v3/users/de48470bf8704989a2877757d18da689 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:41.918481 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a9d6c-9140-4de0-a720-64264cf99ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:41.921463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a9d6c-9140-4de0-a720-64264cf99ecb service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:41.932697 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 975/1974] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:42.173295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:42.174769 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:42.255550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b36438-8431-4f5d-8bec-95da2d238397 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:42.261644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:42.262571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:42.262855 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:42.263134 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] PATH_INFO: `/v3/users/eae6a1e947d44f93b4302f85a091879e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:42.264376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae6a1e947d44f93b4302f85a091879e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:42.266424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:42.314914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae6a1e947d44f93b4302f85a091879e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.329424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae6a1e947d44f93b4302f85a091879e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.331828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae6a1e947d44f93b4302f85a091879e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.345954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae6a1e947d44f93b4302f85a091879e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.346956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae6a1e947d44f93b4302f85a091879e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.367745 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1000/1975] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:42 2021] DELETE /identity/v3/users/eae6a1e947d44f93b4302f85a091879e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:42.573225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a9d6c-9140-4de0-a720-64264cf99ecb service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:42.575922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4c9a9d6c-9140-4de0-a720-64264cf99ecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:42.590937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a9d6c-9140-4de0-a720-64264cf99ecb service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:42.682951 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:42.683760 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:42.684076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:42.684488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] PATH_INFO: `/v3/projects/a56e89e7c17841c1bbe0d709d68ab684` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:42.685934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56e89e7c17841c1bbe0d709d68ab684)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:42.688186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:42.704871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:42.707143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:42.740204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56e89e7c17841c1bbe0d709d68ab684', 'request_id': 'req-fcdba8d3-02a5-4320-9640-331969f72772'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.747115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56e89e7c17841c1bbe0d709d68ab684', 'request_id': 'req-fcdba8d3-02a5-4320-9640-331969f72772'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.752315 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2a9fc-d480-4e4b-b137-b4396cbd17f0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:42.754388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56e89e7c17841c1bbe0d709d68ab684', 'request_id': 'req-fcdba8d3-02a5-4320-9640-331969f72772'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.768579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] The token cache is being invalidate because project a56e89e7c17841c1bbe0d709d68ab684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:42.769362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.771097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-fcdba8d3-02a5-4320-9640-331969f72772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.777978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 976/1976] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:42 2021] DELETE /identity/v3/projects/a56e89e7c17841c1bbe0d709d68ab684 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:42.780228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839ddb0-0fe6-4eed-84d3-5c3ca6799625 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:42.780517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839ddb0-0fe6-4eed-84d3-5c3ca6799625 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:42.780796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839ddb0-0fe6-4eed-84d3-5c3ca6799625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:42.800324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-9839ddb0-0fe6-4eed-84d3-5c3ca6799625 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:42.801569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9839ddb0-0fe6-4eed-84d3-5c3ca6799625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:42.823540 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:42.824422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:42.824960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:42.825229 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] PATH_INFO: `/v3/projects/5e9c283712b1480181b57ffb2a3a1693` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:42.826739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9c283712b1480181b57ffb2a3a1693)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:42.828665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:42.871406 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 977/1977] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:42.881362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cd580-a5ce-4e89-8d8f-a0a1d538fd3b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:42.882417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cd580-a5ce-4e89-8d8f-a0a1d538fd3b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:42.884709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cd580-a5ce-4e89-8d8f-a0a1d538fd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:42.895521 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9c283712b1480181b57ffb2a3a1693', 'request_id': 'req-b67507c7-84f1-49a1-826b-aa700d43c217'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.904971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-ef0cd580-a5ce-4e89-8d8f-a0a1d538fd3b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:42.906166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9c283712b1480181b57ffb2a3a1693', 'request_id': 'req-b67507c7-84f1-49a1-826b-aa700d43c217'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.906340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ef0cd580-a5ce-4e89-8d8f-a0a1d538fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:42.916585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9c283712b1480181b57ffb2a3a1693', 'request_id': 'req-b67507c7-84f1-49a1-826b-aa700d43c217'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.930836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] The token cache is being invalidate because project 5e9c283712b1480181b57ffb2a3a1693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:42.931108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.931780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:42.933690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1001/1978] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:42 2021] DELETE /identity/v3/projects/5e9c283712b1480181b57ffb2a3a1693 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:42.937485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:42.939262 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:42.988219 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 978/1979] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:42.996498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cd580-a5ce-4e89-8d8f-a0a1d538fd3b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.011367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cd580-a5ce-4e89-8d8f-a0a1d538fd3b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.019281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf833cc-0565-47ac-853f-b46fd4ffd27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.020400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf833cc-0565-47ac-853f-b46fd4ffd27b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.020856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf833cc-0565-47ac-853f-b46fd4ffd27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.021310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf833cc-0565-47ac-853f-b46fd4ffd27b admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.022621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf833cc-0565-47ac-853f-b46fd4ffd27b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:43.023176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf833cc-0565-47ac-853f-b46fd4ffd27b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.025885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf833cc-0565-47ac-853f-b46fd4ffd27b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.049847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 979/1980] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:43.052255 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf833cc-0565-47ac-853f-b46fd4ffd27b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.055101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67507c7-84f1-49a1-826b-aa700d43c217 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.061259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e2074-1889-481d-b067-c4897cfa36ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.062693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e2074-1889-481d-b067-c4897cfa36ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.063141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e2074-1889-481d-b067-c4897cfa36ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.063506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e2074-1889-481d-b067-c4897cfa36ae admin admin] PATH_INFO: `/v3/users/094f936d1bd74cfcbca189fd36fef9c2` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.066170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e2074-1889-481d-b067-c4897cfa36ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=094f936d1bd74cfcbca189fd36fef9c2)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.066348 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf833cc-0565-47ac-853f-b46fd4ffd27b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.068594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e2074-1889-481d-b067-c4897cfa36ae admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.072171 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09fb8d-e8c6-497f-9c1f-de0e25025c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.073040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09fb8d-e8c6-497f-9c1f-de0e25025c94 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.073434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09fb8d-e8c6-497f-9c1f-de0e25025c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.073955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09fb8d-e8c6-497f-9c1f-de0e25025c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.074938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09fb8d-e8c6-497f-9c1f-de0e25025c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.077024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09fb8d-e8c6-497f-9c1f-de0e25025c94 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.116633 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 980/1981] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:43 2021] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:37:43.117579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09fb8d-e8c6-497f-9c1f-de0e25025c94 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.130266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1c9e2074-1889-481d-b067-c4897cfa36ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094f936d1bd74cfcbca189fd36fef9c2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:43.139972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1c9e2074-1889-481d-b067-c4897cfa36ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094f936d1bd74cfcbca189fd36fef9c2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:43.140857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1c9e2074-1889-481d-b067-c4897cfa36ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094f936d1bd74cfcbca189fd36fef9c2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:43.158281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1c9e2074-1889-481d-b067-c4897cfa36ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094f936d1bd74cfcbca189fd36fef9c2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:43.159099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1c9e2074-1889-481d-b067-c4897cfa36ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094f936d1bd74cfcbca189fd36fef9c2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:43.177443 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1002/1982] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:42 2021] DELETE /identity/v3/users/094f936d1bd74cfcbca189fd36fef9c2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:43.206240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09fb8d-e8c6-497f-9c1f-de0e25025c94 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.245428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077fca1-3984-45bf-ab21-9d1730369457 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.245723 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077fca1-3984-45bf-ab21-9d1730369457 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.246031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077fca1-3984-45bf-ab21-9d1730369457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.286694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b07b7-7434-475e-a8a2-d40e56c5b58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.286878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-6077fca1-3984-45bf-ab21-9d1730369457 None None] MFA Rules not processed for user `66780c2cebcd40cfa78589c9b4cd4622`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:43.288113 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6077fca1-3984-45bf-ab21-9d1730369457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:43.288555 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b07b7-7434-475e-a8a2-d40e56c5b58f admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.288845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b07b7-7434-475e-a8a2-d40e56c5b58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.289210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b07b7-7434-475e-a8a2-d40e56c5b58f admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.291343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b07b7-7434-475e-a8a2-d40e56c5b58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.293790 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b07b7-7434-475e-a8a2-d40e56c5b58f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.323326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 981/1983] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:43 2021] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:43.327807 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b07b7-7434-475e-a8a2-d40e56c5b58f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.330033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-cc9b07b7-7434-475e-a8a2-d40e56c5b58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:43.344893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b07b7-7434-475e-a8a2-d40e56c5b58f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.350097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a5a1b-2dc0-484d-8c13-84b384520827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.350760 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a5a1b-2dc0-484d-8c13-84b384520827 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.351040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a5a1b-2dc0-484d-8c13-84b384520827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.351314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a5a1b-2dc0-484d-8c13-84b384520827 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.352120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a5a1b-2dc0-484d-8c13-84b384520827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.354250 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a5a1b-2dc0-484d-8c13-84b384520827 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.368472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 982/1984] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:43 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:43.369411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a5a1b-2dc0-484d-8c13-84b384520827 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.377557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1003/1985] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:43 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:43.384576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077fca1-3984-45bf-ab21-9d1730369457 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.386423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6077fca1-3984-45bf-ab21-9d1730369457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:43.390597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a5a1b-2dc0-484d-8c13-84b384520827 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.397883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a6e9-c107-46b2-aa97-3085d21271fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.398737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a6e9-c107-46b2-aa97-3085d21271fe admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.400164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a6e9-c107-46b2-aa97-3085d21271fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.400461 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a6e9-c107-46b2-aa97-3085d21271fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.401797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3a6e9-c107-46b2-aa97-3085d21271fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.403583 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3a6e9-c107-46b2-aa97-3085d21271fe admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.418816 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 983/1986] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:43 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:43.423076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a6e9-c107-46b2-aa97-3085d21271fe admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.434696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a6e9-c107-46b2-aa97-3085d21271fe admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.443719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab0712-4df7-4bda-b12c-a81bcb3722a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.444959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab0712-4df7-4bda-b12c-a81bcb3722a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.445552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab0712-4df7-4bda-b12c-a81bcb3722a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.446058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab0712-4df7-4bda-b12c-a81bcb3722a5 admin admin] PATH_INFO: `/v3/projects/cad43a4f290b4b0a8b94b16ac3c60833/users/b8230e4b51424c23b607b8e680752c4f/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.462235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077fca1-3984-45bf-ab21-9d1730369457 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.466346 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb339ecb-87fd-44e6-b6ee-ba5588e69337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.467201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb339ecb-87fd-44e6-b6ee-ba5588e69337 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.467647 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb339ecb-87fd-44e6-b6ee-ba5588e69337 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.467925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb339ecb-87fd-44e6-b6ee-ba5588e69337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.471252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab0712-4df7-4bda-b12c-a81bcb3722a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad43a4f290b4b0a8b94b16ac3c60833, user_id=b8230e4b51424c23b607b8e680752c4f, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.474012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab0712-4df7-4bda-b12c-a81bcb3722a5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.479996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb339ecb-87fd-44e6-b6ee-ba5588e69337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.481486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb339ecb-87fd-44e6-b6ee-ba5588e69337 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.493618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1004/1987] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:43 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:43.495681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb339ecb-87fd-44e6-b6ee-ba5588e69337 service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.497039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-cb339ecb-87fd-44e6-b6ee-ba5588e69337 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:43.507011 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 984/1988] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:43 2021] PUT /identity/v3/projects/cad43a4f290b4b0a8b94b16ac3c60833/users/b8230e4b51424c23b607b8e680752c4f/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:43.508854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c0e21-4609-4897-acc4-a3cffeed486d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.509139 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c0e21-4609-4897-acc4-a3cffeed486d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.509443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c0e21-4609-4897-acc4-a3cffeed486d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.525598 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb339ecb-87fd-44e6-b6ee-ba5588e69337 service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.549232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-0e8c0e21-4609-4897-acc4-a3cffeed486d None None] MFA Rules not processed for user `b8230e4b51424c23b607b8e680752c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:43.550603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0e8c0e21-4609-4897-acc4-a3cffeed486d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:43.591995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.593012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.593402 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.593870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] PATH_INFO: `/v3/projects/fd8153c577f94375934abe6bf43c6776` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.595206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8153c577f94375934abe6bf43c6776)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.597538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.631744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 985/1989] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:43 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:43.634865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c0e21-4609-4897-acc4-a3cffeed486d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.650959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c0e21-4609-4897-acc4-a3cffeed486d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.651722 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8153c577f94375934abe6bf43c6776', 'request_id': 'req-2ada7dae-5528-41cd-91dc-520a2e75a17d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:43.658674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8153c577f94375934abe6bf43c6776', 'request_id': 'req-2ada7dae-5528-41cd-91dc-520a2e75a17d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:43.668263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8153c577f94375934abe6bf43c6776', 'request_id': 'req-2ada7dae-5528-41cd-91dc-520a2e75a17d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:43.682375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] The token cache is being invalidate because project fd8153c577f94375934abe6bf43c6776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:43.682751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:43.683921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2ada7dae-5528-41cd-91dc-520a2e75a17d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:43.690472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1005/1990] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:43 2021] DELETE /identity/v3/projects/fd8153c577f94375934abe6bf43c6776 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:43.692272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee3bc-69d7-483c-82de-f4d5a3e0ac65 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.692652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee3bc-69d7-483c-82de-f4d5a3e0ac65 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.692985 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee3bc-69d7-483c-82de-f4d5a3e0ac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.726422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-bf9ee3bc-69d7-483c-82de-f4d5a3e0ac65 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:43.728151 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bf9ee3bc-69d7-483c-82de-f4d5a3e0ac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:43.756640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40131fd-9c10-4486-b0fb-839ace545cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.757847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40131fd-9c10-4486-b0fb-839ace545cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.758742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40131fd-9c10-4486-b0fb-839ace545cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.759124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40131fd-9c10-4486-b0fb-839ace545cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.760737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40131fd-9c10-4486-b0fb-839ace545cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.763944 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40131fd-9c10-4486-b0fb-839ace545cf6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.801258 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 986/1991] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:43 2021] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:37:43.815152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40131fd-9c10-4486-b0fb-839ace545cf6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.822893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a40131fd-9c10-4486-b0fb-839ace545cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:43.825031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1006/1992] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:43.838124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c1f2-1c5b-4584-872e-ab19000d23b3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.838345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c1f2-1c5b-4584-872e-ab19000d23b3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.838636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c1f2-1c5b-4584-872e-ab19000d23b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.873907 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-58a8c1f2-1c5b-4584-872e-ab19000d23b3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:43.875214 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-58a8c1f2-1c5b-4584-872e-ab19000d23b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:43.911912 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40131fd-9c10-4486-b0fb-839ace545cf6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.916902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252770-d06e-4c74-9125-db3a694dfacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.917584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252770-d06e-4c74-9125-db3a694dfacd admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.918197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252770-d06e-4c74-9125-db3a694dfacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.918486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252770-d06e-4c74-9125-db3a694dfacd admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.919198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc252770-d06e-4c74-9125-db3a694dfacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.921310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc252770-d06e-4c74-9125-db3a694dfacd admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.942722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 987/1993] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:43 2021] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:43.948206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1007/1994] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:43.948365 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252770-d06e-4c74-9125-db3a694dfacd admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.949117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8c1f2-1c5b-4584-872e-ab19000d23b3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.959041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8c1f2-1c5b-4584-872e-ab19000d23b3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.959208 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252770-d06e-4c74-9125-db3a694dfacd admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.964359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432302e-7150-40df-8ae3-ce7c6cbf34b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.965015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432302e-7150-40df-8ae3-ce7c6cbf34b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.965138 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ef48-753d-466b-af11-596d1bec4333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:43.965292 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432302e-7150-40df-8ae3-ce7c6cbf34b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.965563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432302e-7150-40df-8ae3-ce7c6cbf34b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.965796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ef48-753d-466b-af11-596d1bec4333 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:43.966084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ef48-753d-466b-af11-596d1bec4333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:43.966337 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432302e-7150-40df-8ae3-ce7c6cbf34b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:43.966428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ef48-753d-466b-af11-596d1bec4333 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:43.966637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432302e-7150-40df-8ae3-ce7c6cbf34b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.967090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9ef48-753d-466b-af11-596d1bec4333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:43.968201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432302e-7150-40df-8ae3-ce7c6cbf34b2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.968702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9ef48-753d-466b-af11-596d1bec4333 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:43.981806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 988/1995] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:43 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:43.981992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1008/1996] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:37:43.983614 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ef48-753d-466b-af11-596d1bec4333 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.984327 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432302e-7150-40df-8ae3-ce7c6cbf34b2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:43.994567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ef48-753d-466b-af11-596d1bec4333 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:43.995524 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432302e-7150-40df-8ae3-ce7c6cbf34b2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:44.000403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad294ef3-6143-4109-a45e-c10eb87131e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.001477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad294ef3-6143-4109-a45e-c10eb87131e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.001984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad294ef3-6143-4109-a45e-c10eb87131e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.002547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad294ef3-6143-4109-a45e-c10eb87131e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.003213 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad294ef3-6143-4109-a45e-c10eb87131e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.005403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad294ef3-6143-4109-a45e-c10eb87131e2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.007778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe1e7-87d5-46dc-a817-60d86e7ce2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.009284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe1e7-87d5-46dc-a817-60d86e7ce2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.009604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe1e7-87d5-46dc-a817-60d86e7ce2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.009979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe1e7-87d5-46dc-a817-60d86e7ce2d0 admin admin] PATH_INFO: `/v3/projects/37cdd7e2b1024c8a87aa6a3fd0148173/users/2adab697670a4fa1accf03827350c5d2/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.026025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fe1e7-87d5-46dc-a817-60d86e7ce2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cdd7e2b1024c8a87aa6a3fd0148173, user_id=2adab697670a4fa1accf03827350c5d2, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.028671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fe1e7-87d5-46dc-a817-60d86e7ce2d0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.038873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1009/1997] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:43 2021] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:37:44.043452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad294ef3-6143-4109-a45e-c10eb87131e2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:44.046593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 989/1998] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:43 2021] PUT /identity/v3/projects/37cdd7e2b1024c8a87aa6a3fd0148173/users/2adab697670a4fa1accf03827350c5d2/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:44.050381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe1e7-87d5-46dc-a817-60d86e7ce2d0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:44.107163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad294ef3-6143-4109-a45e-c10eb87131e2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:44.112028 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec1954-f02b-4c9e-a53d-031beff594d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.112728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec1954-f02b-4c9e-a53d-031beff594d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.113008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec1954-f02b-4c9e-a53d-031beff594d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.113284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec1954-f02b-4c9e-a53d-031beff594d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.114026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec1954-f02b-4c9e-a53d-031beff594d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.115950 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec1954-f02b-4c9e-a53d-031beff594d1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.117499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe1e7-87d5-46dc-a817-60d86e7ce2d0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:44.123099 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda17ccb-e8e0-424c-a457-e64e9d571b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.123817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda17ccb-e8e0-424c-a457-e64e9d571b75 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.124082 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda17ccb-e8e0-424c-a457-e64e9d571b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.124354 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda17ccb-e8e0-424c-a457-e64e9d571b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.125095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda17ccb-e8e0-424c-a457-e64e9d571b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.126728 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda17ccb-e8e0-424c-a457-e64e9d571b75 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.139030 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 990/1999] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:44.143119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda17ccb-e8e0-424c-a457-e64e9d571b75 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:44.143300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1010/2000] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:44 2021] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:37:44.148208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec1954-f02b-4c9e-a53d-031beff594d1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:44.153746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda17ccb-e8e0-424c-a457-e64e9d571b75 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:44.161058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aa87e-e7d2-4196-bad6-8e733dbc5921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.162528 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa87e-e7d2-4196-bad6-8e733dbc5921 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.162664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec1954-f02b-4c9e-a53d-031beff594d1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:44.162972 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa87e-e7d2-4196-bad6-8e733dbc5921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.163758 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa87e-e7d2-4196-bad6-8e733dbc5921 admin admin] PATH_INFO: `/v3/projects/37cdd7e2b1024c8a87aa6a3fd0148173/users/2adab697670a4fa1accf03827350c5d2/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.167303 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377aa87e-e7d2-4196-bad6-8e733dbc5921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cdd7e2b1024c8a87aa6a3fd0148173, user_id=2adab697670a4fa1accf03827350c5d2, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.171276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c80ad-b478-4007-be02-dc2d5926dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.172325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c80ad-b478-4007-be02-dc2d5926dd2b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.172426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377aa87e-e7d2-4196-bad6-8e733dbc5921 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.172765 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c80ad-b478-4007-be02-dc2d5926dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.173375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c80ad-b478-4007-be02-dc2d5926dd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.177231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c80ad-b478-4007-be02-dc2d5926dd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.177488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c80ad-b478-4007-be02-dc2d5926dd2b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.194945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 991/2001] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:44 2021] PUT /identity/v3/projects/37cdd7e2b1024c8a87aa6a3fd0148173/users/2adab697670a4fa1accf03827350c5d2/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:44.198585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1011/2002] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:44.203847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aa87e-e7d2-4196-bad6-8e733dbc5921 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:44.210426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b45ba-7f3a-4de5-827d-4b0b7325cf10 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.210840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b45ba-7f3a-4de5-827d-4b0b7325cf10 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.211626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b45ba-7f3a-4de5-827d-4b0b7325cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.256532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-922b45ba-7f3a-4de5-827d-4b0b7325cf10 None None] MFA Rules not processed for user `2adab697670a4fa1accf03827350c5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:44.257810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-922b45ba-7f3a-4de5-827d-4b0b7325cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:44.344842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aa87e-e7d2-4196-bad6-8e733dbc5921 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:44.357114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd399f4-c5ae-4592-9ba5-d88f1d43fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.357830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd399f4-c5ae-4592-9ba5-d88f1d43fbba admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.358114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd399f4-c5ae-4592-9ba5-d88f1d43fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.358390 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd399f4-c5ae-4592-9ba5-d88f1d43fbba admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.359294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd399f4-c5ae-4592-9ba5-d88f1d43fbba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.362273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd399f4-c5ae-4592-9ba5-d88f1d43fbba admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.366132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1012/2003] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:44 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:44.371391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b45ba-7f3a-4de5-827d-4b0b7325cf10 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:44.383350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 992/2004] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:44.388224 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd399f4-c5ae-4592-9ba5-d88f1d43fbba admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:44.399271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd399f4-c5ae-4592-9ba5-d88f1d43fbba admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:44.401161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b45ba-7f3a-4de5-827d-4b0b7325cf10 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:44.405858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636de75-92d0-40dc-8f13-a6f8ea5a5aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.406740 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636de75-92d0-40dc-8f13-a6f8ea5a5aab admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.407018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636de75-92d0-40dc-8f13-a6f8ea5a5aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.407296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636de75-92d0-40dc-8f13-a6f8ea5a5aab admin admin] PATH_INFO: `/v3/projects/755d2002d256440f91e55f3a9bead6aa/users/6f191df814024a6db84cbdbf55bf644b/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.407681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0d184-a5c7-48a1-ae49-968d9206262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.408777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0d184-a5c7-48a1-ae49-968d9206262d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.409082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0d184-a5c7-48a1-ae49-968d9206262d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.409332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0d184-a5c7-48a1-ae49-968d9206262d admin admin] PATH_INFO: `/v3/users/b8230e4b51424c23b607b8e680752c4f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.411813 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0d184-a5c7-48a1-ae49-968d9206262d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8230e4b51424c23b607b8e680752c4f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.412620 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0d184-a5c7-48a1-ae49-968d9206262d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.430904 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636de75-92d0-40dc-8f13-a6f8ea5a5aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=755d2002d256440f91e55f3a9bead6aa, user_id=6f191df814024a6db84cbdbf55bf644b, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.435168 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636de75-92d0-40dc-8f13-a6f8ea5a5aab admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.467026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 993/2005] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:44 2021] PUT /identity/v3/projects/755d2002d256440f91e55f3a9bead6aa/users/6f191df814024a6db84cbdbf55bf644b/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:44.479863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddfab8-7290-4209-a138-7424103860fe None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.480878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddfab8-7290-4209-a138-7424103860fe None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.481423 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddfab8-7290-4209-a138-7424103860fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.491537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b9f0d184-a5c7-48a1-ae49-968d9206262d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8230e4b51424c23b607b8e680752c4f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:44.501619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b9f0d184-a5c7-48a1-ae49-968d9206262d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8230e4b51424c23b607b8e680752c4f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:44.502704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b9f0d184-a5c7-48a1-ae49-968d9206262d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8230e4b51424c23b607b8e680752c4f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:44.525586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b9f0d184-a5c7-48a1-ae49-968d9206262d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8230e4b51424c23b607b8e680752c4f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:44.527441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b9f0d184-a5c7-48a1-ae49-968d9206262d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8230e4b51424c23b607b8e680752c4f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:44.545455 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1013/2006] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:44 2021] DELETE /identity/v3/users/b8230e4b51424c23b607b8e680752c4f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:44.549922 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e03e37-d71e-463e-a412-6d30997ac722 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.550201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e03e37-d71e-463e-a412-6d30997ac722 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.550489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e03e37-d71e-463e-a412-6d30997ac722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.568280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f4ddfab8-7290-4209-a138-7424103860fe None None] MFA Rules not processed for user `6f191df814024a6db84cbdbf55bf644b`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:44.569573 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f4ddfab8-7290-4209-a138-7424103860fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:44.572239 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-f3e03e37-d71e-463e-a412-6d30997ac722 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:44.574330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f3e03e37-d71e-463e-a412-6d30997ac722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:44.647623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1014/2007] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:44.659240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e03e37-d71e-463e-a412-6d30997ac722 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:44.660668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f3e03e37-d71e-463e-a412-6d30997ac722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:44.661635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 994/2008] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:44 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:44.672121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddfab8-7290-4209-a138-7424103860fe None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:44.674634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f4ddfab8-7290-4209-a138-7424103860fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:44.734859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e03e37-d71e-463e-a412-6d30997ac722 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:44.736112 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddfab8-7290-4209-a138-7424103860fe None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:44.739005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2221c5-838e-40ac-9414-b7740ca3d0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.739821 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2221c5-838e-40ac-9414-b7740ca3d0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.740091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60645e7-2c8f-415e-8cd7-720084925bf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.740233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2221c5-838e-40ac-9414-b7740ca3d0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.740534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2221c5-838e-40ac-9414-b7740ca3d0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.740728 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60645e7-2c8f-415e-8cd7-720084925bf6 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.741013 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60645e7-2c8f-415e-8cd7-720084925bf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.741261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60645e7-2c8f-415e-8cd7-720084925bf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.754186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60645e7-2c8f-415e-8cd7-720084925bf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.756024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60645e7-2c8f-415e-8cd7-720084925bf6 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.757565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2221c5-838e-40ac-9414-b7740ca3d0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.759553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2221c5-838e-40ac-9414-b7740ca3d0d8 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.767814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 995/2009] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:44 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:44.769300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1015/2010] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:44.788897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60645e7-2c8f-415e-8cd7-720084925bf6 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:44.790445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b60645e7-2c8f-415e-8cd7-720084925bf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:44.805293 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60645e7-2c8f-415e-8cd7-720084925bf6 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:44.810090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bac07f-fff2-41de-8e59-5bd0acabe3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:44.811141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac07f-fff2-41de-8e59-5bd0acabe3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.811419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac07f-fff2-41de-8e59-5bd0acabe3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.811686 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac07f-fff2-41de-8e59-5bd0acabe3a4 admin admin] PATH_INFO: `/v3/users/6f191df814024a6db84cbdbf55bf644b` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.813043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bac07f-fff2-41de-8e59-5bd0acabe3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f191df814024a6db84cbdbf55bf644b)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:44.815077 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bac07f-fff2-41de-8e59-5bd0acabe3a4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:44.884305 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-60bac07f-fff2-41de-8e59-5bd0acabe3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f191df814024a6db84cbdbf55bf644b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:44.893447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-60bac07f-fff2-41de-8e59-5bd0acabe3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f191df814024a6db84cbdbf55bf644b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:44.902740 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-60bac07f-fff2-41de-8e59-5bd0acabe3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f191df814024a6db84cbdbf55bf644b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:44.926472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-60bac07f-fff2-41de-8e59-5bd0acabe3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f191df814024a6db84cbdbf55bf644b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:44.927305 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-60bac07f-fff2-41de-8e59-5bd0acabe3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f191df814024a6db84cbdbf55bf644b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:44.944683 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f725be-910e-4fd6-bcda-650c1533a356 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.945351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f725be-910e-4fd6-bcda-650c1533a356 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.945351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f725be-910e-4fd6-bcda-650c1533a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.945893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 996/2011] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:44 2021] DELETE /identity/v3/users/6f191df814024a6db84cbdbf55bf644b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:44.948286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f25d-78c8-4958-b416-932be21d4d2a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:44.948682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f25d-78c8-4958-b416-932be21d4d2a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:44.949066 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f25d-78c8-4958-b416-932be21d4d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:44.971124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-49f725be-910e-4fd6-bcda-650c1533a356 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:44.972937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-49f725be-910e-4fd6-bcda-650c1533a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:44.986345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c634f25d-78c8-4958-b416-932be21d4d2a None None] MFA Rules not processed for user `66780c2cebcd40cfa78589c9b4cd4622`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:44.986345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c634f25d-78c8-4958-b416-932be21d4d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:45.073166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 997/2012] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:44 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:45.084461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1016/2013] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:45.104752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634f25d-78c8-4958-b416-932be21d4d2a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:45.106469 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c634f25d-78c8-4958-b416-932be21d4d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:45.213110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634f25d-78c8-4958-b416-932be21d4d2a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:45.220187 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f725be-910e-4fd6-bcda-650c1533a356 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:45.221700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-49f725be-910e-4fd6-bcda-650c1533a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:45.223262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d07d84-e914-4271-9452-f847a4bad30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:45.224325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d07d84-e914-4271-9452-f847a4bad30a service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:45.228051 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d07d84-e914-4271-9452-f847a4bad30a service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:45.228562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d07d84-e914-4271-9452-f847a4bad30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:45.250101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d07d84-e914-4271-9452-f847a4bad30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:45.259990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d07d84-e914-4271-9452-f847a4bad30a service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:45.261930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f725be-910e-4fd6-bcda-650c1533a356 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:45.267322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:45.268334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:45.268726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:45.269103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] PATH_INFO: `/v3/projects/cad43a4f290b4b0a8b94b16ac3c60833` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:45.270864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad43a4f290b4b0a8b94b16ac3c60833)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:45.273278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:45.287575 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 998/2014] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:45.334085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad43a4f290b4b0a8b94b16ac3c60833', 'request_id': 'req-27a019fb-c900-4587-855f-73c349de4d03'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.340389 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad43a4f290b4b0a8b94b16ac3c60833', 'request_id': 'req-27a019fb-c900-4587-855f-73c349de4d03'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.349814 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad43a4f290b4b0a8b94b16ac3c60833', 'request_id': 'req-27a019fb-c900-4587-855f-73c349de4d03'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.370327 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] The token cache is being invalidate because project cad43a4f290b4b0a8b94b16ac3c60833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:45.370327 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.370958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d07d84-e914-4271-9452-f847a4bad30a service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:45.371076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.372973 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1017/2015] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:45 2021] DELETE /identity/v3/projects/cad43a4f290b4b0a8b94b16ac3c60833 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:45.373337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b4d07d84-e914-4271-9452-f847a4bad30a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:45.376867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:45.378373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:45.389493 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d07d84-e914-4271-9452-f847a4bad30a service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:45.462555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a019fb-c900-4587-855f-73c349de4d03 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:45.466502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:45.467376 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:45.467659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:45.467938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] PATH_INFO: `/v3/users/0d3b922358864c6a87cae57d71b6acbd` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:45.468503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89dbf1-4914-4088-8af8-cfa8a6dd4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:45.469398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89dbf1-4914-4088-8af8-cfa8a6dd4bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:45.470071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3b922358864c6a87cae57d71b6acbd)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:45.470445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89dbf1-4914-4088-8af8-cfa8a6dd4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:45.470893 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89dbf1-4914-4088-8af8-cfa8a6dd4bc4 admin admin] PATH_INFO: `/v3/users/2adab697670a4fa1accf03827350c5d2` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:45.472388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89dbf1-4914-4088-8af8-cfa8a6dd4bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2adab697670a4fa1accf03827350c5d2)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:45.472689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:45.474864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89dbf1-4914-4088-8af8-cfa8a6dd4bc4 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:45.534560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3d89dbf1-4914-4088-8af8-cfa8a6dd4bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2adab697670a4fa1accf03827350c5d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.544728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3d89dbf1-4914-4088-8af8-cfa8a6dd4bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2adab697670a4fa1accf03827350c5d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.545483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3d89dbf1-4914-4088-8af8-cfa8a6dd4bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2adab697670a4fa1accf03827350c5d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.564774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3d89dbf1-4914-4088-8af8-cfa8a6dd4bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2adab697670a4fa1accf03827350c5d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.565596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3d89dbf1-4914-4088-8af8-cfa8a6dd4bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2adab697670a4fa1accf03827350c5d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.576652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3b922358864c6a87cae57d71b6acbd'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.589104 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1018/2016] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:45 2021] DELETE /identity/v3/users/2adab697670a4fa1accf03827350c5d2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:45.590715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3b922358864c6a87cae57d71b6acbd'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.600706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3b922358864c6a87cae57d71b6acbd'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.618771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3b922358864c6a87cae57d71b6acbd'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.620122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3b922358864c6a87cae57d71b6acbd'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:45.631387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 999/2017] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:45 2021] DELETE /identity/v3/users/0d3b922358864c6a87cae57d71b6acbd => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:45.636373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f348ce-500a-4f10-a52f-1159e3520042 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:45.636686 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f348ce-500a-4f10-a52f-1159e3520042 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:45.636966 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f348ce-500a-4f10-a52f-1159e3520042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:45.662002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-53f348ce-500a-4f10-a52f-1159e3520042 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:45.663222 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-53f348ce-500a-4f10-a52f-1159e3520042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:45.758519 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1019/2018] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:45.773819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:45.776608 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:45.859810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c920b64-496b-4ed6-a5ee-0b9356bc25ee admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:45.876652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9427045-6dd2-47ce-83cc-1fdd421b2d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:45.877631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9427045-6dd2-47ce-83cc-1fdd421b2d62 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:45.877953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9427045-6dd2-47ce-83cc-1fdd421b2d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:45.878235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9427045-6dd2-47ce-83cc-1fdd421b2d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:45.902613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9427045-6dd2-47ce-83cc-1fdd421b2d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:45.905113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9427045-6dd2-47ce-83cc-1fdd421b2d62 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:45.922137 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1000/2019] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:45.957096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f348ce-500a-4f10-a52f-1159e3520042 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:45.959533 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-53f348ce-500a-4f10-a52f-1159e3520042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:45.995534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f348ce-500a-4f10-a52f-1159e3520042 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:46.001541 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:46.002883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.003257 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.003628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] PATH_INFO: `/v3/projects/755d2002d256440f91e55f3a9bead6aa` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.007632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=755d2002d256440f91e55f3a9bead6aa)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:46.014634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:46.085637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755d2002d256440f91e55f3a9bead6aa', 'request_id': 'req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:46.096257 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755d2002d256440f91e55f3a9bead6aa', 'request_id': 'req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:46.105662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755d2002d256440f91e55f3a9bead6aa', 'request_id': 'req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:46.120254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] The token cache is being invalidate because project 755d2002d256440f91e55f3a9bead6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:46.120683 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:46.121505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:46.123310 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1020/2020] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:45 2021] DELETE /identity/v3/projects/755d2002d256440f91e55f3a9bead6aa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:46.129358 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a963358-90a0-4054-a085-0658c678c2f9 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.129803 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a963358-90a0-4054-a085-0658c678c2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.130086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a963358-90a0-4054-a085-0658c678c2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.193742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-6a963358-90a0-4054-a085-0658c678c2f9 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:46.200358 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-6a963358-90a0-4054-a085-0658c678c2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:46.239230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:46.242017 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:46.353559 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fd90e-c023-4d27-83f2-d8aaff1c5f0c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:46.371803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:46.372780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.373092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.373397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] PATH_INFO: `/v3/projects/37cdd7e2b1024c8a87aa6a3fd0148173` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.374802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37cdd7e2b1024c8a87aa6a3fd0148173)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:46.377806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:46.388443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1001/2021] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:46.398654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4f5a5-3d76-49ab-b4b6-f7123f3697eb None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.400389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4f5a5-3d76-49ab-b4b6-f7123f3697eb None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.400919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4f5a5-3d76-49ab-b4b6-f7123f3697eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.448742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-3fe4f5a5-3d76-49ab-b4b6-f7123f3697eb None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:46.452125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3fe4f5a5-3d76-49ab-b4b6-f7123f3697eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:46.485716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37cdd7e2b1024c8a87aa6a3fd0148173', 'request_id': 'req-1b2eddbe-857c-433b-b516-990e959e7630'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:46.495397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37cdd7e2b1024c8a87aa6a3fd0148173', 'request_id': 'req-1b2eddbe-857c-433b-b516-990e959e7630'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:46.507470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37cdd7e2b1024c8a87aa6a3fd0148173', 'request_id': 'req-1b2eddbe-857c-433b-b516-990e959e7630'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:46.538252 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] The token cache is being invalidate because project 37cdd7e2b1024c8a87aa6a3fd0148173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:46.538560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:46.541937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1b2eddbe-857c-433b-b516-990e959e7630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:46.543650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1021/2022] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:46 2021] DELETE /identity/v3/projects/37cdd7e2b1024c8a87aa6a3fd0148173 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:46.549459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d62b4-f986-4feb-939e-6e289e1733a9 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.549766 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d62b4-f986-4feb-939e-6e289e1733a9 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.550079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d62b4-f986-4feb-939e-6e289e1733a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.550718 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1002/2023] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:46.556984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4f5a5-3d76-49ab-b4b6-f7123f3697eb None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:46.588650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-610d62b4-f986-4feb-939e-6e289e1733a9 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:46.590038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-610d62b4-f986-4feb-939e-6e289e1733a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:46.590833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4f5a5-3d76-49ab-b4b6-f7123f3697eb None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:46.604208 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4678f5b-633e-473e-b671-4dca89b4efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:46.612363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1022/2024] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:46.612578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4678f5b-633e-473e-b671-4dca89b4efb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.612578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4678f5b-633e-473e-b671-4dca89b4efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.612578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4678f5b-633e-473e-b671-4dca89b4efb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.612578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4678f5b-633e-473e-b671-4dca89b4efb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:46.612578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4678f5b-633e-473e-b671-4dca89b4efb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:46.612578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4678f5b-633e-473e-b671-4dca89b4efb4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:46.614452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d0f7-197a-4f12-9d2a-095ac7979f92 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.615396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d0f7-197a-4f12-9d2a-095ac7979f92 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.615707 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d0f7-197a-4f12-9d2a-095ac7979f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.630935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1003/2025] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:46.637361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4678f5b-633e-473e-b671-4dca89b4efb4 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:46.639909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f4678f5b-633e-473e-b671-4dca89b4efb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:46.650026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-b901d0f7-197a-4f12-9d2a-095ac7979f92 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:46.657603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b901d0f7-197a-4f12-9d2a-095ac7979f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:46.665582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4678f5b-633e-473e-b671-4dca89b4efb4 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:46.671793 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1023/2026] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:46.676735 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901d0f7-197a-4f12-9d2a-095ac7979f92 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:46.680015 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bd7d9-46c5-4939-9968-100445733993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:46.681213 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bd7d9-46c5-4939-9968-100445733993 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.682755 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bd7d9-46c5-4939-9968-100445733993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.683394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bd7d9-46c5-4939-9968-100445733993 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.683892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bd7d9-46c5-4939-9968-100445733993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:46.685961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bd7d9-46c5-4939-9968-100445733993 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:46.698725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901d0f7-197a-4f12-9d2a-095ac7979f92 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:46.705057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb386f2d-f7e6-45b0-9954-de0ad4e39a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:46.705785 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb386f2d-f7e6-45b0-9954-de0ad4e39a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.706071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb386f2d-f7e6-45b0-9954-de0ad4e39a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.706353 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb386f2d-f7e6-45b0-9954-de0ad4e39a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.707193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb386f2d-f7e6-45b0-9954-de0ad4e39a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:46.707539 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb386f2d-f7e6-45b0-9954-de0ad4e39a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:46.709453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb386f2d-f7e6-45b0-9954-de0ad4e39a1d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:46.732076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1024/2027] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:46.735646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb386f2d-f7e6-45b0-9954-de0ad4e39a1d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:46.755001 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb386f2d-f7e6-45b0-9954-de0ad4e39a1d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:46.766976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d57e09-f7c7-4e70-b58c-651f51726db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:46.767952 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d57e09-f7c7-4e70-b58c-651f51726db8 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.768237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d57e09-f7c7-4e70-b58c-651f51726db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.768518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d57e09-f7c7-4e70-b58c-651f51726db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.769281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d57e09-f7c7-4e70-b58c-651f51726db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:46.771941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d57e09-f7c7-4e70-b58c-651f51726db8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:46.778751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1004/2028] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:46 2021] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:46.780237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bd7d9-46c5-4939-9968-100445733993 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:46.823290 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1025/2029] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:46 2021] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:37:46.823290 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d57e09-f7c7-4e70-b58c-651f51726db8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:46.827376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-65d57e09-f7c7-4e70-b58c-651f51726db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:46.882281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bd7d9-46c5-4939-9968-100445733993 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:46.959166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21f714-fcde-4e16-8f6c-5a29bc86a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:46.962921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21f714-fcde-4e16-8f6c-5a29bc86a338 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.962921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21f714-fcde-4e16-8f6c-5a29bc86a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.963123 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21f714-fcde-4e16-8f6c-5a29bc86a338 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.963824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21f714-fcde-4e16-8f6c-5a29bc86a338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:46.969857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d57e09-f7c7-4e70-b58c-651f51726db8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:46.972360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21f714-fcde-4e16-8f6c-5a29bc86a338 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:46.981110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:46.982633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:46.983141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:46.983600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] PATH_INFO: `/v3/projects/27f132870b5b4acf9b96f0be357bb8d3` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:46.985580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f132870b5b4acf9b96f0be357bb8d3)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:46.989351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.011165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1005/2030] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:46 2021] POST /identity/v3/users => generated 282 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:47.011165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21f714-fcde-4e16-8f6c-5a29bc86a338 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.029095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21f714-fcde-4e16-8f6c-5a29bc86a338 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.039020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c68609-2731-4a9c-a4bf-c01be77c0ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.040009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68609-2731-4a9c-a4bf-c01be77c0ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.040498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68609-2731-4a9c-a4bf-c01be77c0ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.040857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68609-2731-4a9c-a4bf-c01be77c0ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.042470 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c68609-2731-4a9c-a4bf-c01be77c0ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.046891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c68609-2731-4a9c-a4bf-c01be77c0ec8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.088486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1006/2031] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:47 2021] POST /identity/v3/users => generated 286 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:47.089402 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c68609-2731-4a9c-a4bf-c01be77c0ec8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.100984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f132870b5b4acf9b96f0be357bb8d3', 'request_id': 'req-70a132fe-7f54-461b-986d-f6d929a6bbfc'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:47.101478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c68609-2731-4a9c-a4bf-c01be77c0ec8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.110270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f132870b5b4acf9b96f0be357bb8d3', 'request_id': 'req-70a132fe-7f54-461b-986d-f6d929a6bbfc'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:47.127296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f132870b5b4acf9b96f0be357bb8d3', 'request_id': 'req-70a132fe-7f54-461b-986d-f6d929a6bbfc'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:47.141549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] The token cache is being invalidate because project 27f132870b5b4acf9b96f0be357bb8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:47.142061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:47.142899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:47.144518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1026/2032] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:46 2021] DELETE /identity/v3/projects/27f132870b5b4acf9b96f0be357bb8d3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:47.145275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.146668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:47.165480 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ddad-230b-4959-be99-51d42ae2ce06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.166272 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ddad-230b-4959-be99-51d42ae2ce06 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.166647 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ddad-230b-4959-be99-51d42ae2ce06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.167031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ddad-230b-4959-be99-51d42ae2ce06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.167908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240ddad-230b-4959-be99-51d42ae2ce06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.169576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240ddad-230b-4959-be99-51d42ae2ce06 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.179554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1007/2033] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:47 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:47.181029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ddad-230b-4959-be99-51d42ae2ce06 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.182927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3240ddad-230b-4959-be99-51d42ae2ce06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:47.194968 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ddad-230b-4959-be99-51d42ae2ce06 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.200465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.201330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.201646 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.201946 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] PATH_INFO: `/v3/users/e01d6ccc264e4bd594123fddb97bcde3` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.203145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01d6ccc264e4bd594123fddb97bcde3)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.205061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.235350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a132fe-7f54-461b-986d-f6d929a6bbfc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.242294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cbef7-b1b5-425f-b8f3-02e4f8ddbe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.244208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cbef7-b1b5-425f-b8f3-02e4f8ddbe6f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.244645 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cbef7-b1b5-425f-b8f3-02e4f8ddbe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.245098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cbef7-b1b5-425f-b8f3-02e4f8ddbe6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.246065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cbef7-b1b5-425f-b8f3-02e4f8ddbe6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.247869 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cbef7-b1b5-425f-b8f3-02e4f8ddbe6f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.260424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1027/2034] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:47 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:47.261517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cbef7-b1b5-425f-b8f3-02e4f8ddbe6f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.263410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1b8cbef7-b1b5-425f-b8f3-02e4f8ddbe6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:47.264366 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01d6ccc264e4bd594123fddb97bcde3'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:47.272874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01d6ccc264e4bd594123fddb97bcde3'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:47.277511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cbef7-b1b5-425f-b8f3-02e4f8ddbe6f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.284389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01d6ccc264e4bd594123fddb97bcde3'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:47.284576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e7c8b-9af6-4874-b83c-e07734a20dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.284576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7c8b-9af6-4874-b83c-e07734a20dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.284576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7c8b-9af6-4874-b83c-e07734a20dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.284576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7c8b-9af6-4874-b83c-e07734a20dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.285274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e7c8b-9af6-4874-b83c-e07734a20dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.286908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e7c8b-9af6-4874-b83c-e07734a20dd8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.297294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01d6ccc264e4bd594123fddb97bcde3'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:47.297722 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1028/2035] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:47 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:47.298147 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01d6ccc264e4bd594123fddb97bcde3'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:47.298934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e7c8b-9af6-4874-b83c-e07734a20dd8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.301731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-007e7c8b-9af6-4874-b83c-e07734a20dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:47.305624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1008/2036] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:47 2021] DELETE /identity/v3/users/e01d6ccc264e4bd594123fddb97bcde3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:47.315460 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e7c8b-9af6-4874-b83c-e07734a20dd8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.326932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.328435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:47.405655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7b01c-35f6-427d-832d-8dba5ebf1c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.407558 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7b01c-35f6-427d-832d-8dba5ebf1c4e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.407999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7b01c-35f6-427d-832d-8dba5ebf1c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.408419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7b01c-35f6-427d-832d-8dba5ebf1c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.409334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7b01c-35f6-427d-832d-8dba5ebf1c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.411116 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7b01c-35f6-427d-832d-8dba5ebf1c4e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.417590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb089ac-5adf-4f4b-b156-062ec95ddb74 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.422824 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1029/2037] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:47 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:47.426885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5245f-602f-4fe6-abbd-bc8242bdd45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.427413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7b01c-35f6-427d-832d-8dba5ebf1c4e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.428356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5245f-602f-4fe6-abbd-bc8242bdd45f admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.428643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5245f-602f-4fe6-abbd-bc8242bdd45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.428912 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5245f-602f-4fe6-abbd-bc8242bdd45f admin admin] PATH_INFO: `/v3/projects/d3bdab48838d4b81928d395160ab1d49/users/0e23c50746954d728cfc7423d1eeb061/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.438819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7b01c-35f6-427d-832d-8dba5ebf1c4e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.444339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971727-999f-4cee-9c77-bb3900e0b253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.445556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5245f-602f-4fe6-abbd-bc8242bdd45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bdab48838d4b81928d395160ab1d49, user_id=0e23c50746954d728cfc7423d1eeb061, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.446507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971727-999f-4cee-9c77-bb3900e0b253 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.447032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971727-999f-4cee-9c77-bb3900e0b253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.447410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971727-999f-4cee-9c77-bb3900e0b253 admin admin] PATH_INFO: `/v3/projects/9383e45615eb4e2a8768b6ad2c86bbdd/users/c310e149830e4286aa1ecc5b6831f68c/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.449432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5245f-602f-4fe6-abbd-bc8242bdd45f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.464879 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1009/2038] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:47 2021] PUT /identity/v3/projects/d3bdab48838d4b81928d395160ab1d49/users/0e23c50746954d728cfc7423d1eeb061/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:47.471451 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4971727-999f-4cee-9c77-bb3900e0b253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9383e45615eb4e2a8768b6ad2c86bbdd, user_id=c310e149830e4286aa1ecc5b6831f68c, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.474607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4971727-999f-4cee-9c77-bb3900e0b253 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.475369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac640ec-dcd1-4444-9b8a-acac3a0effbe None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.476276 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac640ec-dcd1-4444-9b8a-acac3a0effbe None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.476684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac640ec-dcd1-4444-9b8a-acac3a0effbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.501807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1030/2039] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:47 2021] PUT /identity/v3/projects/9383e45615eb4e2a8768b6ad2c86bbdd/users/c310e149830e4286aa1ecc5b6831f68c/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:47.509209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80695-d131-49bc-a49f-72346629341b None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.509478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80695-d131-49bc-a49f-72346629341b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.509996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80695-d131-49bc-a49f-72346629341b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.519720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-7ac640ec-dcd1-4444-9b8a-acac3a0effbe None None] MFA Rules not processed for user `0e23c50746954d728cfc7423d1eeb061`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:47.521661 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7ac640ec-dcd1-4444-9b8a-acac3a0effbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:47.540603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-7db80695-d131-49bc-a49f-72346629341b None None] MFA Rules not processed for user `c310e149830e4286aa1ecc5b6831f68c`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:47.542297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7db80695-d131-49bc-a49f-72346629341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:47.654905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1010/2040] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:47 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:47.656122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1031/2041] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:47 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:47.657899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db80695-d131-49bc-a49f-72346629341b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.661392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac640ec-dcd1-4444-9b8a-acac3a0effbe None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.671008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7ac640ec-dcd1-4444-9b8a-acac3a0effbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:47.773971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db80695-d131-49bc-a49f-72346629341b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.781430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465d5b6-9dab-4b66-96ee-196aca1638c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.782378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465d5b6-9dab-4b66-96ee-196aca1638c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.782777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465d5b6-9dab-4b66-96ee-196aca1638c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.783209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465d5b6-9dab-4b66-96ee-196aca1638c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.784111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465d5b6-9dab-4b66-96ee-196aca1638c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.786377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465d5b6-9dab-4b66-96ee-196aca1638c6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.822840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac640ec-dcd1-4444-9b8a-acac3a0effbe None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.838421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1032/2042] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:47 2021] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:47.839600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465d5b6-9dab-4b66-96ee-196aca1638c6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.842773 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f465d5b6-9dab-4b66-96ee-196aca1638c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:47.844977 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778b5e6-c50e-4b97-8ee4-4d0f8181cbed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.845684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b5e6-c50e-4b97-8ee4-4d0f8181cbed service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.845988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b5e6-c50e-4b97-8ee4-4d0f8181cbed service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.846371 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b5e6-c50e-4b97-8ee4-4d0f8181cbed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.885967 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778b5e6-c50e-4b97-8ee4-4d0f8181cbed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.887954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778b5e6-c50e-4b97-8ee4-4d0f8181cbed service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.927814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1011/2043] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:47 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:47.930439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778b5e6-c50e-4b97-8ee4-4d0f8181cbed service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:47.937859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465d5b6-9dab-4b66-96ee-196aca1638c6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.942998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.943857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.944134 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.944407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] PATH_INFO: `/v3/projects/6b96b841694947e7942e2f9f63724835` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.946337 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b96b841694947e7942e2f9f63724835)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.949054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:47.957044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778b5e6-c50e-4b97-8ee4-4d0f8181cbed service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:47.965474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0283938-c806-46e4-9937-f07c4df6d149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:47.966206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0283938-c806-46e4-9937-f07c4df6d149 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:47.966889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0283938-c806-46e4-9937-f07c4df6d149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:47.966889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0283938-c806-46e4-9937-f07c4df6d149 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:47.967454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0283938-c806-46e4-9937-f07c4df6d149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:47.970933 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0283938-c806-46e4-9937-f07c4df6d149 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.010343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1012/2044] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:47 2021] POST /identity/v3/users => generated 293 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:48.012671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0283938-c806-46e4-9937-f07c4df6d149 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:48.023116 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0283938-c806-46e4-9937-f07c4df6d149 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:48.031295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b96b841694947e7942e2f9f63724835', 'request_id': 'req-53917081-9543-4c90-b307-a5e5d065eeae'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:48.042672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b96b841694947e7942e2f9f63724835', 'request_id': 'req-53917081-9543-4c90-b307-a5e5d065eeae'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:48.052491 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b96b841694947e7942e2f9f63724835', 'request_id': 'req-53917081-9543-4c90-b307-a5e5d065eeae'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:48.067635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] The token cache is being invalidate because project 6b96b841694947e7942e2f9f63724835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:48.068039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:48.068853 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-53917081-9543-4c90-b307-a5e5d065eeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:48.081738 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1033/2045] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:47 2021] DELETE /identity/v3/projects/6b96b841694947e7942e2f9f63724835 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:48.087202 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aed98e-0c1b-46f0-963e-3024c655e6be None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.087619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aed98e-0c1b-46f0-963e-3024c655e6be None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.088058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aed98e-0c1b-46f0-963e-3024c655e6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.125460 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a6aed98e-0c1b-46f0-963e-3024c655e6be None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:48.128269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a6aed98e-0c1b-46f0-963e-3024c655e6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:48.143782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563c30d-6bd3-4ce8-85ff-4597743315c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:48.144609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563c30d-6bd3-4ce8-85ff-4597743315c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.145282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563c30d-6bd3-4ce8-85ff-4597743315c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.145282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563c30d-6bd3-4ce8-85ff-4597743315c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.148392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563c30d-6bd3-4ce8-85ff-4597743315c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:48.149505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563c30d-6bd3-4ce8-85ff-4597743315c3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.193564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1013/2046] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:48 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:48.194936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563c30d-6bd3-4ce8-85ff-4597743315c3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:48.202796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-6563c30d-6bd3-4ce8-85ff-4597743315c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:48.222860 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563c30d-6bd3-4ce8-85ff-4597743315c3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:48.227841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aae07-89a5-477c-bcf2-98038e1ee58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:48.228877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aae07-89a5-477c-bcf2-98038e1ee58d admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.229225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aae07-89a5-477c-bcf2-98038e1ee58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.229579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aae07-89a5-477c-bcf2-98038e1ee58d admin admin] PATH_INFO: `/v3/projects/dfb31a71565842119cd33165282963d4/users/25504421827e4af8822e9a154cad8afa/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.231413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1034/2047] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:48.237230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1205-ef7f-4756-a641-a1af45f91173 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.238235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1205-ef7f-4756-a641-a1af45f91173 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.238602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1205-ef7f-4756-a641-a1af45f91173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.269725 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575aae07-89a5-477c-bcf2-98038e1ee58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb31a71565842119cd33165282963d4, user_id=25504421827e4af8822e9a154cad8afa, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:48.272440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575aae07-89a5-477c-bcf2-98038e1ee58d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.276235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2d4a1205-ef7f-4756-a641-a1af45f91173 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:48.278022 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2d4a1205-ef7f-4756-a641-a1af45f91173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:48.287887 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1035/2048] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:48.292633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a1205-ef7f-4756-a641-a1af45f91173 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:48.293413 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1014/2049] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:48 2021] PUT /identity/v3/projects/dfb31a71565842119cd33165282963d4/users/25504421827e4af8822e9a154cad8afa/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:48.297277 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aae07-89a5-477c-bcf2-98038e1ee58d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:48.304545 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a1205-ef7f-4756-a641-a1af45f91173 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:48.393892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d55c4-7d2d-48ee-8156-524c902ea63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:48.394567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d55c4-7d2d-48ee-8156-524c902ea63a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.394849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d55c4-7d2d-48ee-8156-524c902ea63a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.395119 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d55c4-7d2d-48ee-8156-524c902ea63a admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.395964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d55c4-7d2d-48ee-8156-524c902ea63a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:48.396464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d55c4-7d2d-48ee-8156-524c902ea63a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:48.398379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d55c4-7d2d-48ee-8156-524c902ea63a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.399467 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aae07-89a5-477c-bcf2-98038e1ee58d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:48.415291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8886c0-bcbc-4d4b-a1bc-1ded282172c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:48.416127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8886c0-bcbc-4d4b-a1bc-1ded282172c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.416438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8886c0-bcbc-4d4b-a1bc-1ded282172c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.416758 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8886c0-bcbc-4d4b-a1bc-1ded282172c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.417510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8886c0-bcbc-4d4b-a1bc-1ded282172c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:48.419209 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8886c0-bcbc-4d4b-a1bc-1ded282172c6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.426899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1036/2050] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:48.431658 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d55c4-7d2d-48ee-8156-524c902ea63a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:48.448502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1015/2051] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:48 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:48.454144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8886c0-bcbc-4d4b-a1bc-1ded282172c6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:48.457281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d55c4-7d2d-48ee-8156-524c902ea63a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:48.477629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d976f15-7f22-45a1-af0b-924f31a35be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:48.477629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976f15-7f22-45a1-af0b-924f31a35be8 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.477629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976f15-7f22-45a1-af0b-924f31a35be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.477629 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976f15-7f22-45a1-af0b-924f31a35be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.478039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d976f15-7f22-45a1-af0b-924f31a35be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:48.478039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d976f15-7f22-45a1-af0b-924f31a35be8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.478949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8886c0-bcbc-4d4b-a1bc-1ded282172c6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:48.487098 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c67874-8f12-41c9-97c9-49fed90c6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:48.488443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c67874-8f12-41c9-97c9-49fed90c6d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.488885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c67874-8f12-41c9-97c9-49fed90c6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.489154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c67874-8f12-41c9-97c9-49fed90c6d70 admin admin] PATH_INFO: `/v3/projects/dfb31a71565842119cd33165282963d4/users/25504421827e4af8822e9a154cad8afa/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.491766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c67874-8f12-41c9-97c9-49fed90c6d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb31a71565842119cd33165282963d4, user_id=25504421827e4af8822e9a154cad8afa, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:48.495450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c67874-8f12-41c9-97c9-49fed90c6d70 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.507715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1016/2052] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:48 2021] PUT /identity/v3/projects/dfb31a71565842119cd33165282963d4/users/25504421827e4af8822e9a154cad8afa/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:48.510191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1037/2053] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:48 2021] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:48.514767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c67874-8f12-41c9-97c9-49fed90c6d70 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:48.518872 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2565288-b3d8-4145-9391-5e733ea29616 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.519152 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2565288-b3d8-4145-9391-5e733ea29616 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.519422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2565288-b3d8-4145-9391-5e733ea29616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.550961 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-f2565288-b3d8-4145-9391-5e733ea29616 None None] MFA Rules not processed for user `25504421827e4af8822e9a154cad8afa`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:48.552226 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f2565288-b3d8-4145-9391-5e733ea29616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:48.591078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c67874-8f12-41c9-97c9-49fed90c6d70 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:48.636575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1038/2054] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:48 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:48.648250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2565288-b3d8-4145-9391-5e733ea29616 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:48.650873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f2565288-b3d8-4145-9391-5e733ea29616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:48.672918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672d6f2-9c2f-42df-a91b-9dedffca3977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:48.673684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d6f2-9c2f-42df-a91b-9dedffca3977 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.674065 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d6f2-9c2f-42df-a91b-9dedffca3977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.674415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d6f2-9c2f-42df-a91b-9dedffca3977 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.675207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672d6f2-9c2f-42df-a91b-9dedffca3977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:48.677262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672d6f2-9c2f-42df-a91b-9dedffca3977 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.709940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1017/2055] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:48 2021] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:48.711942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672d6f2-9c2f-42df-a91b-9dedffca3977 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:48.739041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2565288-b3d8-4145-9391-5e733ea29616 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:48.741983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672d6f2-9c2f-42df-a91b-9dedffca3977 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:48.744560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6239670-4707-46ec-981d-7c58a4b7a429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:48.745440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6239670-4707-46ec-981d-7c58a4b7a429 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.745865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6239670-4707-46ec-981d-7c58a4b7a429 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.746612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6239670-4707-46ec-981d-7c58a4b7a429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.747419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9572773-7fda-47ed-bc56-a4ff36fcefdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:48.748302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9572773-7fda-47ed-bc56-a4ff36fcefdc admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.748668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9572773-7fda-47ed-bc56-a4ff36fcefdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.749048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9572773-7fda-47ed-bc56-a4ff36fcefdc admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.750552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9572773-7fda-47ed-bc56-a4ff36fcefdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:48.752270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9572773-7fda-47ed-bc56-a4ff36fcefdc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.758135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6239670-4707-46ec-981d-7c58a4b7a429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:48.760963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6239670-4707-46ec-981d-7c58a4b7a429 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.769930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1018/2056] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:48 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:48.771442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1039/2057] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:48 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:48.773549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9572773-7fda-47ed-bc56-a4ff36fcefdc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:48.786524 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9572773-7fda-47ed-bc56-a4ff36fcefdc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:48.792518 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035539d-61e3-498b-a7e8-a55b2ccc66a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:48.793343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035539d-61e3-498b-a7e8-a55b2ccc66a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.793651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035539d-61e3-498b-a7e8-a55b2ccc66a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.793959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035539d-61e3-498b-a7e8-a55b2ccc66a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.794785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035539d-61e3-498b-a7e8-a55b2ccc66a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:48.796479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035539d-61e3-498b-a7e8-a55b2ccc66a6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.808035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1019/2058] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:48.811625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6239670-4707-46ec-981d-7c58a4b7a429 service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:48.822015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6239670-4707-46ec-981d-7c58a4b7a429 service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:48.826911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af11ec7-071b-4e07-a79a-b764c79406b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:48.827780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af11ec7-071b-4e07-a79a-b764c79406b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.828106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af11ec7-071b-4e07-a79a-b764c79406b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.828343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af11ec7-071b-4e07-a79a-b764c79406b9 admin admin] PATH_INFO: `/v3/projects/4580d7307e1641cbb1896843df075e54/users/e6eb77fa28f540a9a923ccba0f148b79/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.852749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af11ec7-071b-4e07-a79a-b764c79406b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4580d7307e1641cbb1896843df075e54, user_id=e6eb77fa28f540a9a923ccba0f148b79, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:48.855730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af11ec7-071b-4e07-a79a-b764c79406b9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:48.886506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1040/2059] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:48 2021] PUT /identity/v3/projects/4580d7307e1641cbb1896843df075e54/users/e6eb77fa28f540a9a923ccba0f148b79/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:48.888551 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f4635-b832-4170-9a62-3a2323c0294b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:48.889022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f4635-b832-4170-9a62-3a2323c0294b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:48.889408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f4635-b832-4170-9a62-3a2323c0294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:48.930026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b25f4635-b832-4170-9a62-3a2323c0294b None None] MFA Rules not processed for user `e6eb77fa28f540a9a923ccba0f148b79`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:48.931330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b25f4635-b832-4170-9a62-3a2323c0294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:49.021741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1020/2060] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:48 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:49.026098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af11ec7-071b-4e07-a79a-b764c79406b9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:49.125909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f4635-b832-4170-9a62-3a2323c0294b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:49.139793 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af11ec7-071b-4e07-a79a-b764c79406b9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:49.141514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f4635-b832-4170-9a62-3a2323c0294b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:49.146239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eb012-d7f9-4f02-bac7-a59920a1a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:49.147103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f91869-0c68-4a53-97fb-433468ac363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:49.147247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb012-d7f9-4f02-bac7-a59920a1a26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:49.147431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb012-d7f9-4f02-bac7-a59920a1a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:49.147662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb012-d7f9-4f02-bac7-a59920a1a26f admin admin] PATH_INFO: `/v3/users/c310e149830e4286aa1ecc5b6831f68c` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:49.148623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f91869-0c68-4a53-97fb-433468ac363b admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:49.148904 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eb012-d7f9-4f02-bac7-a59920a1a26f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c310e149830e4286aa1ecc5b6831f68c)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:49.149398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f91869-0c68-4a53-97fb-433468ac363b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:49.149936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f91869-0c68-4a53-97fb-433468ac363b admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:49.150873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eb012-d7f9-4f02-bac7-a59920a1a26f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:49.151799 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f91869-0c68-4a53-97fb-433468ac363b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:49.155284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f91869-0c68-4a53-97fb-433468ac363b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:49.190007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1041/2061] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:49 2021] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:49.194073 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f91869-0c68-4a53-97fb-433468ac363b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:49.206317 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-db7eb012-d7f9-4f02-bac7-a59920a1a26f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c310e149830e4286aa1ecc5b6831f68c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:49.213810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-db7eb012-d7f9-4f02-bac7-a59920a1a26f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c310e149830e4286aa1ecc5b6831f68c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:49.222748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-db7eb012-d7f9-4f02-bac7-a59920a1a26f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c310e149830e4286aa1ecc5b6831f68c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:49.237649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-db7eb012-d7f9-4f02-bac7-a59920a1a26f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c310e149830e4286aa1ecc5b6831f68c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:49.238381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-db7eb012-d7f9-4f02-bac7-a59920a1a26f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c310e149830e4286aa1ecc5b6831f68c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:49.245804 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1021/2062] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:49 2021] DELETE /identity/v3/users/c310e149830e4286aa1ecc5b6831f68c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:49.249796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc74ce-9c20-4b98-9581-3b726eef4a8d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:49.250085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc74ce-9c20-4b98-9581-3b726eef4a8d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:49.250446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc74ce-9c20-4b98-9581-3b726eef4a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:49.267240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f91869-0c68-4a53-97fb-433468ac363b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:49.270637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-2cfc74ce-9c20-4b98-9581-3b726eef4a8d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:49.271684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2cfc74ce-9c20-4b98-9581-3b726eef4a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:49.337366 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943188c-839b-4e57-8959-017cafad7757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:49.338295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943188c-839b-4e57-8959-017cafad7757 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:49.339132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943188c-839b-4e57-8959-017cafad7757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:49.339132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943188c-839b-4e57-8959-017cafad7757 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:49.340246 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943188c-839b-4e57-8959-017cafad7757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:49.342607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943188c-839b-4e57-8959-017cafad7757 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:49.358745 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1022/2063] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:49.373730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc74ce-9c20-4b98-9581-3b726eef4a8d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:49.377589 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1042/2064] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:49 2021] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:49.377715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2cfc74ce-9c20-4b98-9581-3b726eef4a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:49.379055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943188c-839b-4e57-8959-017cafad7757 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:49.380602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3943188c-839b-4e57-8959-017cafad7757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:49.412012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943188c-839b-4e57-8959-017cafad7757 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:49.419054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dd128-55ef-41a4-b112-8bfe2cd92d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:49.420490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dd128-55ef-41a4-b112-8bfe2cd92d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:49.420854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dd128-55ef-41a4-b112-8bfe2cd92d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:49.421203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dd128-55ef-41a4-b112-8bfe2cd92d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:49.423178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dd128-55ef-41a4-b112-8bfe2cd92d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:49.423762 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dd128-55ef-41a4-b112-8bfe2cd92d47 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:49.439133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1043/2065] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:49 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:49.443357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dd128-55ef-41a4-b112-8bfe2cd92d47 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:49.456107 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dd128-55ef-41a4-b112-8bfe2cd92d47 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:49.463947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60902f0c-9f39-44ff-95b0-7dce386ecadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:49.465106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60902f0c-9f39-44ff-95b0-7dce386ecadc admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:49.465570 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60902f0c-9f39-44ff-95b0-7dce386ecadc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:49.465958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60902f0c-9f39-44ff-95b0-7dce386ecadc admin admin] PATH_INFO: `/v3/projects/2e2de554132944d294ca9fc5dcf8d6d5/users/a9425c53fe134b58a96c7eb219a8c8e1/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:49.501161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60902f0c-9f39-44ff-95b0-7dce386ecadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2de554132944d294ca9fc5dcf8d6d5, user_id=a9425c53fe134b58a96c7eb219a8c8e1, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:49.504501 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60902f0c-9f39-44ff-95b0-7dce386ecadc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:49.506076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc74ce-9c20-4b98-9581-3b726eef4a8d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:49.513080 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f50a-b107-4b50-8f8c-3972de711c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:49.517675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f50a-b107-4b50-8f8c-3972de711c17 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:49.517675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f50a-b107-4b50-8f8c-3972de711c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:49.517675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f50a-b107-4b50-8f8c-3972de711c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:49.533905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1044/2066] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:49 2021] PUT /identity/v3/projects/2e2de554132944d294ca9fc5dcf8d6d5/users/a9425c53fe134b58a96c7eb219a8c8e1/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:49.537815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60902f0c-9f39-44ff-95b0-7dce386ecadc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:49.543031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330f50a-b107-4b50-8f8c-3972de711c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:49.548349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330f50a-b107-4b50-8f8c-3972de711c17 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:49.575720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1023/2067] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:49.691785 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60902f0c-9f39-44ff-95b0-7dce386ecadc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:49.718555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b4785-91a9-4175-beb1-0c09fd409c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:49.719418 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4785-91a9-4175-beb1-0c09fd409c2d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:49.719803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4785-91a9-4175-beb1-0c09fd409c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:49.720178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4785-91a9-4175-beb1-0c09fd409c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:49.721183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b4785-91a9-4175-beb1-0c09fd409c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:49.723311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b4785-91a9-4175-beb1-0c09fd409c2d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:49.757808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1045/2068] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:49 2021] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:49.762419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f50a-b107-4b50-8f8c-3972de711c17 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:49.775962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f50a-b107-4b50-8f8c-3972de711c17 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:49.814546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91e3e7-8917-479a-959b-190a2a173e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:49.815995 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e3e7-8917-479a-959b-190a2a173e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:49.816378 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e3e7-8917-479a-959b-190a2a173e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:49.816751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e3e7-8917-479a-959b-190a2a173e17 admin admin] PATH_INFO: `/v3/projects/2e2de554132944d294ca9fc5dcf8d6d5/users/a9425c53fe134b58a96c7eb219a8c8e1/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:49.823804 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91e3e7-8917-479a-959b-190a2a173e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2de554132944d294ca9fc5dcf8d6d5, user_id=a9425c53fe134b58a96c7eb219a8c8e1, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:49.826744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91e3e7-8917-479a-959b-190a2a173e17 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:49.841587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b4785-91a9-4175-beb1-0c09fd409c2d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:49.843624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5a4b4785-91a9-4175-beb1-0c09fd409c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:49.861735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1024/2069] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:49 2021] PUT /identity/v3/projects/2e2de554132944d294ca9fc5dcf8d6d5/users/a9425c53fe134b58a96c7eb219a8c8e1/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:49.863455 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5119bb-b83c-47a9-88c6-27e024f1e629 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:49.863743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5119bb-b83c-47a9-88c6-27e024f1e629 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:49.864056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5119bb-b83c-47a9-88c6-27e024f1e629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:49.865208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b4785-91a9-4175-beb1-0c09fd409c2d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:49.924189 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-7d5119bb-b83c-47a9-88c6-27e024f1e629 None None] MFA Rules not processed for user `a9425c53fe134b58a96c7eb219a8c8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:49.925411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7d5119bb-b83c-47a9-88c6-27e024f1e629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:49.964245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad68c3c-772d-4188-bf81-67ed4a132af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:49.966309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad68c3c-772d-4188-bf81-67ed4a132af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:49.967542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad68c3c-772d-4188-bf81-67ed4a132af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:49.968694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad68c3c-772d-4188-bf81-67ed4a132af4 admin admin] PATH_INFO: `/v3/users/ef9b0a4b7e2a42518d3e358fe82cef16` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:49.972070 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad68c3c-772d-4188-bf81-67ed4a132af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef9b0a4b7e2a42518d3e358fe82cef16)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:49.979790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad68c3c-772d-4188-bf81-67ed4a132af4 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:50.032735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1025/2070] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:49 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:50.048189 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5119bb-b83c-47a9-88c6-27e024f1e629 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:50.049785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7d5119bb-b83c-47a9-88c6-27e024f1e629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:50.068403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1ad68c3c-772d-4188-bf81-67ed4a132af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef9b0a4b7e2a42518d3e358fe82cef16'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.078033 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1ad68c3c-772d-4188-bf81-67ed4a132af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef9b0a4b7e2a42518d3e358fe82cef16'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.078867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1ad68c3c-772d-4188-bf81-67ed4a132af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef9b0a4b7e2a42518d3e358fe82cef16'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.099428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1ad68c3c-772d-4188-bf81-67ed4a132af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef9b0a4b7e2a42518d3e358fe82cef16'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.100584 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1ad68c3c-772d-4188-bf81-67ed4a132af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef9b0a4b7e2a42518d3e358fe82cef16'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.118478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1046/2071] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:49 2021] DELETE /identity/v3/users/ef9b0a4b7e2a42518d3e358fe82cef16 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:50.122861 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8619d87-6895-4a6c-a4b6-c0dcc8d38320 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:50.123280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8619d87-6895-4a6c-a4b6-c0dcc8d38320 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:50.134243 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8619d87-6895-4a6c-a4b6-c0dcc8d38320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:50.176255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a8619d87-6895-4a6c-a4b6-c0dcc8d38320 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:50.177555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a8619d87-6895-4a6c-a4b6-c0dcc8d38320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:50.186105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5119bb-b83c-47a9-88c6-27e024f1e629 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:50.293918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1047/2072] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:50.297319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005df26-14d1-43b7-85a6-187af5eec858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:50.298117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8619d87-6895-4a6c-a4b6-c0dcc8d38320 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:50.298249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005df26-14d1-43b7-85a6-187af5eec858 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:50.298630 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005df26-14d1-43b7-85a6-187af5eec858 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:50.298989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005df26-14d1-43b7-85a6-187af5eec858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:50.300169 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a8619d87-6895-4a6c-a4b6-c0dcc8d38320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:50.301122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f005df26-14d1-43b7-85a6-187af5eec858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:50.316231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8619d87-6895-4a6c-a4b6-c0dcc8d38320 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:50.322310 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:50.323289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:50.323641 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:50.323918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] PATH_INFO: `/v3/projects/9383e45615eb4e2a8768b6ad2c86bbdd` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:50.325917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9383e45615eb4e2a8768b6ad2c86bbdd)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:50.328425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:50.388693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005df26-14d1-43b7-85a6-187af5eec858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:50.390370 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005df26-14d1-43b7-85a6-187af5eec858 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:50.405403 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1026/2073] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:50 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:50.411962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005df26-14d1-43b7-85a6-187af5eec858 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:50.412441 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f005df26-14d1-43b7-85a6-187af5eec858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:50.416004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9383e45615eb4e2a8768b6ad2c86bbdd', 'request_id': 'req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.431766 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9383e45615eb4e2a8768b6ad2c86bbdd', 'request_id': 'req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.442445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9383e45615eb4e2a8768b6ad2c86bbdd', 'request_id': 'req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.457128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] The token cache is being invalidate because project 9383e45615eb4e2a8768b6ad2c86bbdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:50.457494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.458268 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.460056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1048/2074] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:50 2021] DELETE /identity/v3/projects/9383e45615eb4e2a8768b6ad2c86bbdd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:50.465051 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:50.466543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:50.495974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005df26-14d1-43b7-85a6-187af5eec858 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:50.547436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a8ddd-7314-4faf-b58b-c5c8a9b4810e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:50.549086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ea124-81d7-457f-8b19-ec10665c7e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:50.549873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea124-81d7-457f-8b19-ec10665c7e71 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:50.550226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea124-81d7-457f-8b19-ec10665c7e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:50.550573 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea124-81d7-457f-8b19-ec10665c7e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:50.552444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9b6ea124-81d7-457f-8b19-ec10665c7e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:50.554585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:50.555880 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:50.556331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:50.556671 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] PATH_INFO: `/v3/users/25504421827e4af8822e9a154cad8afa` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:50.558015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=25504421827e4af8822e9a154cad8afa)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:50.559983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:50.564773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ea124-81d7-457f-8b19-ec10665c7e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:50.566321 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ea124-81d7-457f-8b19-ec10665c7e71 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:50.576780 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1027/2075] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:50.577705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ea124-81d7-457f-8b19-ec10665c7e71 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:50.579121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9b6ea124-81d7-457f-8b19-ec10665c7e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:50.621537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25504421827e4af8822e9a154cad8afa'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.635434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25504421827e4af8822e9a154cad8afa'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.636374 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25504421827e4af8822e9a154cad8afa'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.643823 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ea124-81d7-457f-8b19-ec10665c7e71 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:50.649829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607c27f-cfd4-4f03-a432-2fa230b2b811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:50.650597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c27f-cfd4-4f03-a432-2fa230b2b811 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:50.653964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25504421827e4af8822e9a154cad8afa'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.654146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c27f-cfd4-4f03-a432-2fa230b2b811 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:50.654146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c27f-cfd4-4f03-a432-2fa230b2b811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:50.654146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8607c27f-cfd4-4f03-a432-2fa230b2b811 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:50.654869 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25504421827e4af8822e9a154cad8afa'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:50.675364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1049/2076] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:50 2021] DELETE /identity/v3/users/25504421827e4af8822e9a154cad8afa => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:50.718649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607c27f-cfd4-4f03-a432-2fa230b2b811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:50.720090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607c27f-cfd4-4f03-a432-2fa230b2b811 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:50.729197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1028/2077] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:50 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:51.529565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:51.531960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:51.597473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607c27f-cfd4-4f03-a432-2fa230b2b811 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:51.601425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8607c27f-cfd4-4f03-a432-2fa230b2b811 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:51.631214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607c27f-cfd4-4f03-a432-2fa230b2b811 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:51.698416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6e476-025c-4098-8fee-7fe8e2bcb28f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:51.707026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:51.707774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:51.708180 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:51.708555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] PATH_INFO: `/v3/projects/c875e932f33f4dada66d8d6bec6eafb5` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:51.710259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c875e932f33f4dada66d8d6bec6eafb5)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:51.714293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:51.718664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:51.720185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:51.720185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:51.720185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] PATH_INFO: `/v3/projects/dfb31a71565842119cd33165282963d4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:51.721407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb31a71565842119cd33165282963d4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:51.723812 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:51.776701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c875e932f33f4dada66d8d6bec6eafb5', 'request_id': 'req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:51.783416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c875e932f33f4dada66d8d6bec6eafb5', 'request_id': 'req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:51.785140 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb31a71565842119cd33165282963d4', 'request_id': 'req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:51.791705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c875e932f33f4dada66d8d6bec6eafb5', 'request_id': 'req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:51.793486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb31a71565842119cd33165282963d4', 'request_id': 'req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:51.802016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb31a71565842119cd33165282963d4', 'request_id': 'req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:51.806151 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] The token cache is being invalidate because project c875e932f33f4dada66d8d6bec6eafb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:51.806445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:51.807117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-7c42dc8f-1adb-44c4-9c47-ba8425c882d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:51.809106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1050/2078] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:51 2021] DELETE /identity/v3/projects/c875e932f33f4dada66d8d6bec6eafb5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:51.814427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda7518-5d65-46cd-8eab-d9d50736b04e None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:51.814719 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda7518-5d65-46cd-8eab-d9d50736b04e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:51.815006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda7518-5d65-46cd-8eab-d9d50736b04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:51.816511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] The token cache is being invalidate because project dfb31a71565842119cd33165282963d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:51.816958 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:51.817635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-2a9ebbd3-e8a3-4d5e-8bc6-570c9054812a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:51.821829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1029/2079] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:51 2021] DELETE /identity/v3/projects/dfb31a71565842119cd33165282963d4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:51.826604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b699-b8a5-499f-a790-b5385b779c85 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:51.828345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b699-b8a5-499f-a790-b5385b779c85 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:51.828837 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b699-b8a5-499f-a790-b5385b779c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:51.836259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8dda7518-5d65-46cd-8eab-d9d50736b04e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:51.837618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8dda7518-5d65-46cd-8eab-d9d50736b04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:51.857075 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-ee89b699-b8a5-499f-a790-b5385b779c85 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:51.858574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ee89b699-b8a5-499f-a790-b5385b779c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:51.911869 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1051/2080] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:51.920341 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e577f5e-4150-4b40-9386-86156f8edfb7 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:51.920636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e577f5e-4150-4b40-9386-86156f8edfb7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:51.920922 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e577f5e-4150-4b40-9386-86156f8edfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:51.936700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1030/2081] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:51.938392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89b699-b8a5-499f-a790-b5385b779c85 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:51.943211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ee89b699-b8a5-499f-a790-b5385b779c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:51.954694 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-7e577f5e-4150-4b40-9386-86156f8edfb7 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:51.955925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7e577f5e-4150-4b40-9386-86156f8edfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:51.959796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89b699-b8a5-499f-a790-b5385b779c85 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:51.964082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1052/2082] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:51.967249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3fcb-09f1-4332-b044-eed7345dc5c6 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:51.967249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3fcb-09f1-4332-b044-eed7345dc5c6 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:51.967249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3fcb-09f1-4332-b044-eed7345dc5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:51.968158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:51.969045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:51.969334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:51.969603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] PATH_INFO: `/v3/users/84d42046f04e4d819193d705bf4557f4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:51.970885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d42046f04e4d819193d705bf4557f4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:51.972796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:51.985426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-da0d3fcb-09f1-4332-b044-eed7345dc5c6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:51.986681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-da0d3fcb-09f1-4332-b044-eed7345dc5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:51.998490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1053/2083] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:51.998490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d3fcb-09f1-4332-b044-eed7345dc5c6 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.008405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d3fcb-09f1-4332-b044-eed7345dc5c6 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.015311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b92de-7c37-45f5-9c77-15b290b198b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.015311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b92de-7c37-45f5-9c77-15b290b198b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.015634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b92de-7c37-45f5-9c77-15b290b198b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.016287 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b92de-7c37-45f5-9c77-15b290b198b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.016672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b92de-7c37-45f5-9c77-15b290b198b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:52.016951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b92de-7c37-45f5-9c77-15b290b198b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.018764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b92de-7c37-45f5-9c77-15b290b198b1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.031437 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1054/2084] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:52.032525 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b92de-7c37-45f5-9c77-15b290b198b1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.035185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d42046f04e4d819193d705bf4557f4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:52.042770 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d42046f04e4d819193d705bf4557f4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:52.044049 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b92de-7c37-45f5-9c77-15b290b198b1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.051653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9140f4-213b-41e1-8363-46ae461507ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.052258 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9140f4-213b-41e1-8363-46ae461507ee admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.053069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9140f4-213b-41e1-8363-46ae461507ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.053373 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d42046f04e4d819193d705bf4557f4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:52.053454 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9140f4-213b-41e1-8363-46ae461507ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.053669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9140f4-213b-41e1-8363-46ae461507ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:52.054078 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9140f4-213b-41e1-8363-46ae461507ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.056548 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9140f4-213b-41e1-8363-46ae461507ee admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.069033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d42046f04e4d819193d705bf4557f4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:52.069704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1055/2085] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:52.069900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d42046f04e4d819193d705bf4557f4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:52.070385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9140f4-213b-41e1-8363-46ae461507ee admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.072118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1e9140f4-213b-41e1-8363-46ae461507ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:52.077358 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1031/2086] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:51 2021] DELETE /identity/v3/users/84d42046f04e4d819193d705bf4557f4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:52.078313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.079808 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:52.100787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9140f4-213b-41e1-8363-46ae461507ee admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.179742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea730ea-7539-40a3-878c-6222f194fe12 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.191693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c2664-ba35-4cb1-9ea8-ebbc76d2c50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.191693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2664-ba35-4cb1-9ea8-ebbc76d2c50f admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.191693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2664-ba35-4cb1-9ea8-ebbc76d2c50f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.191693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2664-ba35-4cb1-9ea8-ebbc76d2c50f admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.192083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c2664-ba35-4cb1-9ea8-ebbc76d2c50f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.192083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c2664-ba35-4cb1-9ea8-ebbc76d2c50f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.198511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e375dcc-510f-4045-8f69-dac4c2a5a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.199179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e375dcc-510f-4045-8f69-dac4c2a5a089 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.199457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e375dcc-510f-4045-8f69-dac4c2a5a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.199731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e375dcc-510f-4045-8f69-dac4c2a5a089 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.200693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e375dcc-510f-4045-8f69-dac4c2a5a089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.204050 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e375dcc-510f-4045-8f69-dac4c2a5a089 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.225373 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1032/2087] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:52 2021] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:52.230734 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c2664-ba35-4cb1-9ea8-ebbc76d2c50f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.243835 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1056/2088] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:52 2021] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:52.246079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e375dcc-510f-4045-8f69-dac4c2a5a089 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.342557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c2664-ba35-4cb1-9ea8-ebbc76d2c50f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.386595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e375dcc-510f-4045-8f69-dac4c2a5a089 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.393419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14107d-0890-4508-8f38-9a69c7173bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.394331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14107d-0890-4508-8f38-9a69c7173bbe admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.395238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14107d-0890-4508-8f38-9a69c7173bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.395238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14107d-0890-4508-8f38-9a69c7173bbe admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.395787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14107d-0890-4508-8f38-9a69c7173bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.397886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14107d-0890-4508-8f38-9a69c7173bbe admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.422544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57885012-0f6f-489b-9d49-6520460d0a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.423288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57885012-0f6f-489b-9d49-6520460d0a9d admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.423633 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57885012-0f6f-489b-9d49-6520460d0a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.423912 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57885012-0f6f-489b-9d49-6520460d0a9d admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.424682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57885012-0f6f-489b-9d49-6520460d0a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.424872 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1057/2089] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:52 2021] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:52.425714 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14107d-0890-4508-8f38-9a69c7173bbe admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.426784 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57885012-0f6f-489b-9d49-6520460d0a9d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.429547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4f14107d-0890-4508-8f38-9a69c7173bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:52.443894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14107d-0890-4508-8f38-9a69c7173bbe admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.448842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.449731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.450291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.450565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] PATH_INFO: `/v3/projects/cbc3fb62e6fd4e12b55c29b671482f9d` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.450850 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1033/2090] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:52 2021] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:37:52.451690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57885012-0f6f-489b-9d49-6520460d0a9d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.454768 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc3fb62e6fd4e12b55c29b671482f9d)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.456724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.465064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57885012-0f6f-489b-9d49-6520460d0a9d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.470609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92857d-de3c-488f-a343-6330357b8a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.471314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92857d-de3c-488f-a343-6330357b8a69 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.471594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92857d-de3c-488f-a343-6330357b8a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.471888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92857d-de3c-488f-a343-6330357b8a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.472643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92857d-de3c-488f-a343-6330357b8a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.474281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92857d-de3c-488f-a343-6330357b8a69 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.489165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1034/2091] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:52.490155 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92857d-de3c-488f-a343-6330357b8a69 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.503801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92857d-de3c-488f-a343-6330357b8a69 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.523503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'request_id': 'req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:52.538511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'request_id': 'req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:52.549551 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'request_id': 'req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:52.562574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] The token cache is being invalidate because project cbc3fb62e6fd4e12b55c29b671482f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:52.562940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:52.563793 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:52.565412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1058/2092] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:52 2021] DELETE /identity/v3/projects/cbc3fb62e6fd4e12b55c29b671482f9d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:52.566408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.567794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:52.586277 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bfa9f-86aa-4752-93cb-37c5492cce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.587604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfa9f-86aa-4752-93cb-37c5492cce2d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.588101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfa9f-86aa-4752-93cb-37c5492cce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.588260 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfa9f-86aa-4752-93cb-37c5492cce2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.589041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bfa9f-86aa-4752-93cb-37c5492cce2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.591098 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bfa9f-86aa-4752-93cb-37c5492cce2d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.610620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1035/2093] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:52.610620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac32fd4-2e2b-4c4d-9b03-3dbc5be5cc82 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.610620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac32fd4-2e2b-4c4d-9b03-3dbc5be5cc82 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.610620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac32fd4-2e2b-4c4d-9b03-3dbc5be5cc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.631411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-9ac32fd4-2e2b-4c4d-9b03-3dbc5be5cc82 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:52.632587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9ac32fd4-2e2b-4c4d-9b03-3dbc5be5cc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:52.645805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1036/2094] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:52.645805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac32fd4-2e2b-4c4d-9b03-3dbc5be5cc82 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.646346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9ac32fd4-2e2b-4c4d-9b03-3dbc5be5cc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:52.666447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac32fd4-2e2b-4c4d-9b03-3dbc5be5cc82 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.671722 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c6587-c32d-419b-b3c5-b25f5e9fb71d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.673733 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d7faa-3796-484c-9cc4-812d4b799833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.674651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d7faa-3796-484c-9cc4-812d4b799833 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.674771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d7faa-3796-484c-9cc4-812d4b799833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.675020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d7faa-3796-484c-9cc4-812d4b799833 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.675762 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d7faa-3796-484c-9cc4-812d4b799833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.677094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93c579-5888-418c-a194-0968d95d689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.677390 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d7faa-3796-484c-9cc4-812d4b799833 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.677854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93c579-5888-418c-a194-0968d95d689a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.678141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93c579-5888-418c-a194-0968d95d689a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.678421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93c579-5888-418c-a194-0968d95d689a admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.679168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93c579-5888-418c-a194-0968d95d689a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.680809 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93c579-5888-418c-a194-0968d95d689a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.691710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1037/2095] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:52.691710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb561-4c4a-4e7a-baa1-4105ed758120 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.691710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb561-4c4a-4e7a-baa1-4105ed758120 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.691710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb561-4c4a-4e7a-baa1-4105ed758120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.697393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1059/2096] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:52.697393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93c579-5888-418c-a194-0968d95d689a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.707012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93c579-5888-418c-a194-0968d95d689a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.712729 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6cd77-3fa3-4d14-a48e-0331c19ca2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.713814 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6cd77-3fa3-4d14-a48e-0331c19ca2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.714218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6cd77-3fa3-4d14-a48e-0331c19ca2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.714954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6cd77-3fa3-4d14-a48e-0331c19ca2a7 admin admin] PATH_INFO: `/v3/projects/c310e32a51634083a2c3c2d5975ef66b/users/b448653b982f434b8b98cc4c1d252ff6/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.719843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-9b8bb561-4c4a-4e7a-baa1-4105ed758120 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:52.721071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9b8bb561-4c4a-4e7a-baa1-4105ed758120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:52.730134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1038/2097] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:52.731008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bb561-4c4a-4e7a-baa1-4105ed758120 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.738712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6cd77-3fa3-4d14-a48e-0331c19ca2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c310e32a51634083a2c3c2d5975ef66b, user_id=b448653b982f434b8b98cc4c1d252ff6, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.741460 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6cd77-3fa3-4d14-a48e-0331c19ca2a7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.745699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bb561-4c4a-4e7a-baa1-4105ed758120 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.755010 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81927c7f-d316-4e41-ae2f-53a59b4791ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.756073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81927c7f-d316-4e41-ae2f-53a59b4791ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.756422 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81927c7f-d316-4e41-ae2f-53a59b4791ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.756742 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81927c7f-d316-4e41-ae2f-53a59b4791ec admin admin] PATH_INFO: `/v3/projects/c0da9050a08e442887ca8dc346374836/users/7e3a3afdfc4c44a29d0f3df50a5ed2ac/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.761391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1060/2098] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:52 2021] PUT /identity/v3/projects/c310e32a51634083a2c3c2d5975ef66b/users/b448653b982f434b8b98cc4c1d252ff6/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:52.762508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6cd77-3fa3-4d14-a48e-0331c19ca2a7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.786599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81927c7f-d316-4e41-ae2f-53a59b4791ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0da9050a08e442887ca8dc346374836, user_id=7e3a3afdfc4c44a29d0f3df50a5ed2ac, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.790672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81927c7f-d316-4e41-ae2f-53a59b4791ec admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.815174 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1039/2099] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:52 2021] PUT /identity/v3/projects/c0da9050a08e442887ca8dc346374836/users/7e3a3afdfc4c44a29d0f3df50a5ed2ac/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:52.816283 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a36e7-1d1c-41dc-bd57-a61f9bb4e3fb None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.816639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a36e7-1d1c-41dc-bd57-a61f9bb4e3fb None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.817446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a36e7-1d1c-41dc-bd57-a61f9bb4e3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.840744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6cd77-3fa3-4d14-a48e-0331c19ca2a7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.852280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-3f7a36e7-1d1c-41dc-bd57-a61f9bb4e3fb None None] MFA Rules not processed for user `b448653b982f434b8b98cc4c1d252ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:52.853504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3f7a36e7-1d1c-41dc-bd57-a61f9bb4e3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:52.905476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e221ec-2f81-4fd9-93b3-470e3d3bc45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.906180 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e221ec-2f81-4fd9-93b3-470e3d3bc45d admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.906458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e221ec-2f81-4fd9-93b3-470e3d3bc45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.906763 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e221ec-2f81-4fd9-93b3-470e3d3bc45d admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.907682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e221ec-2f81-4fd9-93b3-470e3d3bc45d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:52.907874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e221ec-2f81-4fd9-93b3-470e3d3bc45d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.909726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e221ec-2f81-4fd9-93b3-470e3d3bc45d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.921468 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1061/2100] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:52.925548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1040/2101] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:52 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:52.925681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356559-50fc-4b8c-a7b6-c0891ac96e2b None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.925681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356559-50fc-4b8c-a7b6-c0891ac96e2b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.925681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356559-50fc-4b8c-a7b6-c0891ac96e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.926729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a36e7-1d1c-41dc-bd57-a61f9bb4e3fb None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.939101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a36e7-1d1c-41dc-bd57-a61f9bb4e3fb None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.942126 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-60356559-50fc-4b8c-a7b6-c0891ac96e2b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:52.943363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-60356559-50fc-4b8c-a7b6-c0891ac96e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:52.943751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dc98e-5850-4d6a-a2b8-07ab0d2fe347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.944409 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dc98e-5850-4d6a-a2b8-07ab0d2fe347 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.944687 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dc98e-5850-4d6a-a2b8-07ab0d2fe347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.944959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dc98e-5850-4d6a-a2b8-07ab0d2fe347 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.945656 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dc98e-5850-4d6a-a2b8-07ab0d2fe347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.948120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dc98e-5850-4d6a-a2b8-07ab0d2fe347 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.952022 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1062/2102] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:52.952879 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60356559-50fc-4b8c-a7b6-c0891ac96e2b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.963125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60356559-50fc-4b8c-a7b6-c0891ac96e2b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:52.968720 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bf03b-cd6c-4f31-81d2-10ea07dcb107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:52.969432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bf03b-cd6c-4f31-81d2-10ea07dcb107 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:52.969715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bf03b-cd6c-4f31-81d2-10ea07dcb107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:52.970023 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bf03b-cd6c-4f31-81d2-10ea07dcb107 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:52.970728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bf03b-cd6c-4f31-81d2-10ea07dcb107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:52.972609 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bf03b-cd6c-4f31-81d2-10ea07dcb107 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:52.978999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1041/2103] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:52 2021] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:37:52.978999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dc98e-5850-4d6a-a2b8-07ab0d2fe347 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:52.978999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-729dc98e-5850-4d6a-a2b8-07ab0d2fe347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:53.005588 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1063/2104] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:52 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:53.005588 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bf03b-cd6c-4f31-81d2-10ea07dcb107 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.036387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dc98e-5850-4d6a-a2b8-07ab0d2fe347 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.063091 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bf03b-cd6c-4f31-81d2-10ea07dcb107 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.067604 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf7712-8fb5-4129-aafc-0c59b37dd366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.068294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf7712-8fb5-4129-aafc-0c59b37dd366 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.068571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf7712-8fb5-4129-aafc-0c59b37dd366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.068847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf7712-8fb5-4129-aafc-0c59b37dd366 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.069547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf7712-8fb5-4129-aafc-0c59b37dd366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.072027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf7712-8fb5-4129-aafc-0c59b37dd366 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.084845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b2853-6a1c-4284-a030-d3485254fece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.085533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2853-6a1c-4284-a030-d3485254fece service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.085931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2853-6a1c-4284-a030-d3485254fece service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.086128 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2853-6a1c-4284-a030-d3485254fece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.092618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1064/2105] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:53 2021] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:53.093432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf7712-8fb5-4129-aafc-0c59b37dd366 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.097331 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b2853-6a1c-4284-a030-d3485254fece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.098905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b2853-6a1c-4284-a030-d3485254fece service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.103954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf7712-8fb5-4129-aafc-0c59b37dd366 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.108900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf6753-7032-4418-9aea-f87e1ce72289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.109061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1042/2106] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:53.109710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf6753-7032-4418-9aea-f87e1ce72289 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.109867 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b2853-6a1c-4284-a030-d3485254fece service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.110035 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf6753-7032-4418-9aea-f87e1ce72289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.110391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf6753-7032-4418-9aea-f87e1ce72289 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.111256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf6753-7032-4418-9aea-f87e1ce72289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.113183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf6753-7032-4418-9aea-f87e1ce72289 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.119930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b2853-6a1c-4284-a030-d3485254fece service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.128309 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb7ef9-8bfb-475e-bb89-4b9217913e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.128910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7ef9-8bfb-475e-bb89-4b9217913e58 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.129196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7ef9-8bfb-475e-bb89-4b9217913e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.129506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7ef9-8bfb-475e-bb89-4b9217913e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.130310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb7ef9-8bfb-475e-bb89-4b9217913e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.131991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb7ef9-8bfb-475e-bb89-4b9217913e58 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.137113 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1065/2107] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:53 2021] POST /identity/v3/users => generated 299 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:53.141264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf6753-7032-4418-9aea-f87e1ce72289 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.147118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1043/2108] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:53 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:53.148343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb7ef9-8bfb-475e-bb89-4b9217913e58 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.152083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf6753-7032-4418-9aea-f87e1ce72289 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.157498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a9fab-1172-4b3b-ac5a-deb1949ec031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.158196 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9fab-1172-4b3b-ac5a-deb1949ec031 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.158477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9fab-1172-4b3b-ac5a-deb1949ec031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.158716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb7ef9-8bfb-475e-bb89-4b9217913e58 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.158816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9fab-1172-4b3b-ac5a-deb1949ec031 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.159476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a9fab-1172-4b3b-ac5a-deb1949ec031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.161057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a9fab-1172-4b3b-ac5a-deb1949ec031 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.164106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159da6f-5ac5-4f02-af08-c0d70759eccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.164927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159da6f-5ac5-4f02-af08-c0d70759eccc admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.165224 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159da6f-5ac5-4f02-af08-c0d70759eccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.165500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159da6f-5ac5-4f02-af08-c0d70759eccc admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.166312 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159da6f-5ac5-4f02-af08-c0d70759eccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.167895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159da6f-5ac5-4f02-af08-c0d70759eccc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.173710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1066/2109] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:53 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:53.176752 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a9fab-1172-4b3b-ac5a-deb1949ec031 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.182587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1044/2110] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:53.183753 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159da6f-5ac5-4f02-af08-c0d70759eccc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.188433 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a9fab-1172-4b3b-ac5a-deb1949ec031 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.192977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ebb9f-23d9-4a42-b3f4-b59362e6ef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.193615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159da6f-5ac5-4f02-af08-c0d70759eccc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.193888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebb9f-23d9-4a42-b3f4-b59362e6ef95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.194170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebb9f-23d9-4a42-b3f4-b59362e6ef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.194557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebb9f-23d9-4a42-b3f4-b59362e6ef95 admin admin] PATH_INFO: `/v3/projects/d4ffc6ac5a9a4e8397e31f85d509a1c2/users/a1af328d2bc34833891fb2fa163e0dd4/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.201263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3bfb6-e11d-4bbe-97f9-926a9732de6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.202600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3bfb6-e11d-4bbe-97f9-926a9732de6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.202961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3bfb6-e11d-4bbe-97f9-926a9732de6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.203266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3bfb6-e11d-4bbe-97f9-926a9732de6f admin admin] PATH_INFO: `/v3/projects/f6fe0d2a84684c76af0ea767b460f0ac/users/e4939b1619fa4abbaaf1e128e643278c/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.211789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ebb9f-23d9-4a42-b3f4-b59362e6ef95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ffc6ac5a9a4e8397e31f85d509a1c2, user_id=a1af328d2bc34833891fb2fa163e0dd4, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.214531 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ebb9f-23d9-4a42-b3f4-b59362e6ef95 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.221320 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3bfb6-e11d-4bbe-97f9-926a9732de6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6fe0d2a84684c76af0ea767b460f0ac, user_id=e4939b1619fa4abbaaf1e128e643278c, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.224293 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3bfb6-e11d-4bbe-97f9-926a9732de6f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.229205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1067/2111] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:53 2021] PUT /identity/v3/projects/d4ffc6ac5a9a4e8397e31f85d509a1c2/users/a1af328d2bc34833891fb2fa163e0dd4/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:53.233327 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ebb9f-23d9-4a42-b3f4-b59362e6ef95 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.239059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1045/2112] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:53 2021] PUT /identity/v3/projects/f6fe0d2a84684c76af0ea767b460f0ac/users/e4939b1619fa4abbaaf1e128e643278c/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:53.250058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f9c9e-5682-4f53-afda-328238331eb3 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.250489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f9c9e-5682-4f53-afda-328238331eb3 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.250920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f9c9e-5682-4f53-afda-328238331eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.284964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-635f9c9e-5682-4f53-afda-328238331eb3 None None] MFA Rules not processed for user `e4939b1619fa4abbaaf1e128e643278c`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:53.286242 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-635f9c9e-5682-4f53-afda-328238331eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:53.323749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ebb9f-23d9-4a42-b3f4-b59362e6ef95 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.359779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1046/2113] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:53 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:53.364014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f9c9e-5682-4f53-afda-328238331eb3 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.389336 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59311fc-fbd0-40c3-8b1c-670bc0955c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.390323 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59311fc-fbd0-40c3-8b1c-670bc0955c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.390607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59311fc-fbd0-40c3-8b1c-670bc0955c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.390882 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59311fc-fbd0-40c3-8b1c-670bc0955c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.391625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59311fc-fbd0-40c3-8b1c-670bc0955c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.393631 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59311fc-fbd0-40c3-8b1c-670bc0955c31 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.408228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1068/2114] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:53 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:53.409822 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59311fc-fbd0-40c3-8b1c-670bc0955c31 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.415888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f59311fc-fbd0-40c3-8b1c-670bc0955c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:53.435825 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59311fc-fbd0-40c3-8b1c-670bc0955c31 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.441565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f9c9e-5682-4f53-afda-328238331eb3 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.444697 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.446758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.447046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.447357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] PATH_INFO: `/v3/users/e6eb77fa28f540a9a923ccba0f148b79` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.448888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6eb77fa28f540a9a923ccba0f148b79)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.449993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7100232-e1bd-4882-ae1b-a13ef4ebbb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.451415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7100232-e1bd-4882-ae1b-a13ef4ebbb5f admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.451794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.454150 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7100232-e1bd-4882-ae1b-a13ef4ebbb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.454602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7100232-e1bd-4882-ae1b-a13ef4ebbb5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.455344 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7100232-e1bd-4882-ae1b-a13ef4ebbb5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.457263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7100232-e1bd-4882-ae1b-a13ef4ebbb5f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.516338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1047/2115] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:53 2021] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:37:53.520721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7100232-e1bd-4882-ae1b-a13ef4ebbb5f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.544645 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6eb77fa28f540a9a923ccba0f148b79'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:53.556755 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6eb77fa28f540a9a923ccba0f148b79'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:53.557540 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6eb77fa28f540a9a923ccba0f148b79'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:53.582418 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6eb77fa28f540a9a923ccba0f148b79'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:53.584444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6eb77fa28f540a9a923ccba0f148b79'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:53.609918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1069/2116] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:53 2021] DELETE /identity/v3/users/e6eb77fa28f540a9a923ccba0f148b79 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:53.611436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.613353 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:53.639984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7100232-e1bd-4882-ae1b-a13ef4ebbb5f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.723598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ff19d-960b-4d9a-bc62-04c783392675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.724507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ff19d-960b-4d9a-bc62-04c783392675 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.724793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ff19d-960b-4d9a-bc62-04c783392675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.725066 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ff19d-960b-4d9a-bc62-04c783392675 admin admin] PATH_INFO: `/v3/projects/d4ffc6ac5a9a4e8397e31f85d509a1c2/users/a1af328d2bc34833891fb2fa163e0dd4/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.727653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ff19d-960b-4d9a-bc62-04c783392675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ffc6ac5a9a4e8397e31f85d509a1c2, user_id=a1af328d2bc34833891fb2fa163e0dd4, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.733987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ff19d-960b-4d9a-bc62-04c783392675 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.757068 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1048/2117] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:53 2021] PUT /identity/v3/projects/d4ffc6ac5a9a4e8397e31f85d509a1c2/users/a1af328d2bc34833891fb2fa163e0dd4/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:53.760824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa768e1-21d2-4cd0-8d7d-bf19cc0a4718 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.760824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa768e1-21d2-4cd0-8d7d-bf19cc0a4718 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.760824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa768e1-21d2-4cd0-8d7d-bf19cc0a4718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.765986 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df097734-86b5-4b66-bc83-60d4727fbbe8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.798911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-9fa768e1-21d2-4cd0-8d7d-bf19cc0a4718 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:53.800152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9fa768e1-21d2-4cd0-8d7d-bf19cc0a4718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:53.864480 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cc3fa-23d8-4756-8682-d2b2d98f2074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.865409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cc3fa-23d8-4756-8682-d2b2d98f2074 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.866781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cc3fa-23d8-4756-8682-d2b2d98f2074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.867087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cc3fa-23d8-4756-8682-d2b2d98f2074 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.868456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cc3fa-23d8-4756-8682-d2b2d98f2074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.871324 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cc3fa-23d8-4756-8682-d2b2d98f2074 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:53.902522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1070/2118] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:53 2021] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:53.902522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d0b2-5162-406d-8679-410d7f2be150 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.902879 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d0b2-5162-406d-8679-410d7f2be150 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.902963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d0b2-5162-406d-8679-410d7f2be150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.945109 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1049/2119] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:53.947776 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa768e1-21d2-4cd0-8d7d-bf19cc0a4718 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:53.969984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-0a29d0b2-5162-406d-8679-410d7f2be150 None None] MFA Rules not processed for user `a1af328d2bc34833891fb2fa163e0dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:53.970154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa768e1-21d2-4cd0-8d7d-bf19cc0a4718 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:53.971442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0a29d0b2-5162-406d-8679-410d7f2be150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:53.985957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04c0c5-0dbb-47f4-ac85-c4f3f2ab8399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:53.987104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04c0c5-0dbb-47f4-ac85-c4f3f2ab8399 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:53.987386 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04c0c5-0dbb-47f4-ac85-c4f3f2ab8399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:53.987752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04c0c5-0dbb-47f4-ac85-c4f3f2ab8399 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:53.988567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04c0c5-0dbb-47f4-ac85-c4f3f2ab8399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:53.990790 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04c0c5-0dbb-47f4-ac85-c4f3f2ab8399 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:54.040757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1050/2120] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:53 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:54.042886 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04c0c5-0dbb-47f4-ac85-c4f3f2ab8399 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:54.047694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4c04c0c5-0dbb-47f4-ac85-c4f3f2ab8399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:54.080455 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1071/2121] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:53 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:54.081533 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d0b2-5162-406d-8679-410d7f2be150 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:54.095465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d0b2-5162-406d-8679-410d7f2be150 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:54.103007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b12e0-4daa-44a8-b6f7-16cbea6f3c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:54.104261 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b12e0-4daa-44a8-b6f7-16cbea6f3c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:54.104540 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b12e0-4daa-44a8-b6f7-16cbea6f3c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:54.104815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b12e0-4daa-44a8-b6f7-16cbea6f3c75 admin admin] PATH_INFO: `/v3/projects/bd49926f446b4a1682867118bb1bc532/users/87e6b849e9ef4a56b857ddfddd8633f8/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:54.125269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b12e0-4daa-44a8-b6f7-16cbea6f3c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd49926f446b4a1682867118bb1bc532, user_id=87e6b849e9ef4a56b857ddfddd8633f8, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:54.128360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b12e0-4daa-44a8-b6f7-16cbea6f3c75 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:54.148503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1072/2122] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:54 2021] PUT /identity/v3/projects/bd49926f446b4a1682867118bb1bc532/users/87e6b849e9ef4a56b857ddfddd8633f8/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:54.149894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b12e0-4daa-44a8-b6f7-16cbea6f3c75 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:54.152809 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d58b12e0-4daa-44a8-b6f7-16cbea6f3c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:54.200757 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04c0c5-0dbb-47f4-ac85-c4f3f2ab8399 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:54.242511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b12e0-4daa-44a8-b6f7-16cbea6f3c75 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:54.248303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d0d24-fdde-4ab7-a89d-20b38667898d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:54.249494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d0d24-fdde-4ab7-a89d-20b38667898d service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:54.249940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d0d24-fdde-4ab7-a89d-20b38667898d service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:54.250230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d0d24-fdde-4ab7-a89d-20b38667898d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:54.334291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acece89-3440-44e6-8505-c9e967539089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:54.334536 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acece89-3440-44e6-8505-c9e967539089 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:54.334741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acece89-3440-44e6-8505-c9e967539089 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:54.335003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acece89-3440-44e6-8505-c9e967539089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:54.362346 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d0d24-fdde-4ab7-a89d-20b38667898d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:54.364358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d0d24-fdde-4ab7-a89d-20b38667898d service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:54.382193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1073/2123] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:54 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:54.383229 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d0d24-fdde-4ab7-a89d-20b38667898d service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:54.494152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acece89-3440-44e6-8505-c9e967539089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:54.501534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acece89-3440-44e6-8505-c9e967539089 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:54.505607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d0d24-fdde-4ab7-a89d-20b38667898d service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:54.512852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec2545-7f1a-46c8-a74f-be033c795812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:54.513613 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec2545-7f1a-46c8-a74f-be033c795812 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:54.514120 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec2545-7f1a-46c8-a74f-be033c795812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:54.514410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec2545-7f1a-46c8-a74f-be033c795812 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:54.515208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec2545-7f1a-46c8-a74f-be033c795812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:54.517102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec2545-7f1a-46c8-a74f-be033c795812 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:54.519638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1051/2124] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:54.520931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acece89-3440-44e6-8505-c9e967539089 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:54.523292 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4acece89-3440-44e6-8505-c9e967539089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:54.539315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acece89-3440-44e6-8505-c9e967539089 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:54.552793 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1074/2125] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:54 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:54.553342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa1cd2-036e-48cd-b72d-d27a22e18348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:54.553513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa1cd2-036e-48cd-b72d-d27a22e18348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:54.554598 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec2545-7f1a-46c8-a74f-be033c795812 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:54.555144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa1cd2-036e-48cd-b72d-d27a22e18348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:54.556031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa1cd2-036e-48cd-b72d-d27a22e18348 admin admin] PATH_INFO: `/v3/users/b448653b982f434b8b98cc4c1d252ff6` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:54.562788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa1cd2-036e-48cd-b72d-d27a22e18348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b448653b982f434b8b98cc4c1d252ff6)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:54.567114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa1cd2-036e-48cd-b72d-d27a22e18348 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:54.567988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec2545-7f1a-46c8-a74f-be033c795812 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:54.574360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f2dbb-f5b2-4cf0-a0dd-f9e1ffbcfa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:54.576250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f2dbb-f5b2-4cf0-a0dd-f9e1ffbcfa29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:54.576688 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f2dbb-f5b2-4cf0-a0dd-f9e1ffbcfa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:54.577061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f2dbb-f5b2-4cf0-a0dd-f9e1ffbcfa29 admin admin] PATH_INFO: `/v3/projects/bd49926f446b4a1682867118bb1bc532/users/87e6b849e9ef4a56b857ddfddd8633f8/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:54.581006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f2dbb-f5b2-4cf0-a0dd-f9e1ffbcfa29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd49926f446b4a1682867118bb1bc532, user_id=87e6b849e9ef4a56b857ddfddd8633f8, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:54.584320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f2dbb-f5b2-4cf0-a0dd-f9e1ffbcfa29 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:54.601445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1075/2126] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:54 2021] PUT /identity/v3/projects/bd49926f446b4a1682867118bb1bc532/users/87e6b849e9ef4a56b857ddfddd8633f8/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:54.615218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f550d5-8bfc-4ab1-9fac-048d9c73ddca None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:54.615996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f550d5-8bfc-4ab1-9fac-048d9c73ddca None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:54.616361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f550d5-8bfc-4ab1-9fac-048d9c73ddca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:54.673771 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a7f550d5-8bfc-4ab1-9fac-048d9c73ddca None None] MFA Rules not processed for user `87e6b849e9ef4a56b857ddfddd8633f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:54.675203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a7f550d5-8bfc-4ab1-9fac-048d9c73ddca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:54.688730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-6efa1cd2-036e-48cd-b72d-d27a22e18348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b448653b982f434b8b98cc4c1d252ff6'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:54.715187 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-6efa1cd2-036e-48cd-b72d-d27a22e18348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b448653b982f434b8b98cc4c1d252ff6'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:54.736659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-6efa1cd2-036e-48cd-b72d-d27a22e18348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b448653b982f434b8b98cc4c1d252ff6'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:54.772089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-6efa1cd2-036e-48cd-b72d-d27a22e18348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b448653b982f434b8b98cc4c1d252ff6'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:54.773058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-6efa1cd2-036e-48cd-b72d-d27a22e18348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b448653b982f434b8b98cc4c1d252ff6'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:54.786023 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1076/2127] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:54 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:54.794903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f550d5-8bfc-4ab1-9fac-048d9c73ddca None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:54.797927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1052/2128] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:54 2021] DELETE /identity/v3/users/b448653b982f434b8b98cc4c1d252ff6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:54.804407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b15aa-40ef-4695-a3db-b7ca65994f92 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:54.804407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b15aa-40ef-4695-a3db-b7ca65994f92 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:54.804763 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b15aa-40ef-4695-a3db-b7ca65994f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:54.840267 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d78b15aa-40ef-4695-a3db-b7ca65994f92 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:54.842938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d78b15aa-40ef-4695-a3db-b7ca65994f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:54.895573 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f550d5-8bfc-4ab1-9fac-048d9c73ddca None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:54.996980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1053/2129] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:55.005024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf955208-c6d1-4ba9-9b98-434ecdf62046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:55.005205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf955208-c6d1-4ba9-9b98-434ecdf62046 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:55.005481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf955208-c6d1-4ba9-9b98-434ecdf62046 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:55.005819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf955208-c6d1-4ba9-9b98-434ecdf62046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:55.009840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b15aa-40ef-4695-a3db-b7ca65994f92 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:55.011385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d78b15aa-40ef-4695-a3db-b7ca65994f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:55.020966 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bf955208-c6d1-4ba9-9b98-434ecdf62046 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:55.148185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b15aa-40ef-4695-a3db-b7ca65994f92 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:55.154544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a27f6-69ef-432d-b210-72c4160c2d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:55.154816 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a27f6-69ef-432d-b210-72c4160c2d5d service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:55.155086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a27f6-69ef-432d-b210-72c4160c2d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:55.155525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a27f6-69ef-432d-b210-72c4160c2d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:55.170878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a27f6-69ef-432d-b210-72c4160c2d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:55.172367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a27f6-69ef-432d-b210-72c4160c2d5d service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:55.183979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1054/2130] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:37:55.184851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a27f6-69ef-432d-b210-72c4160c2d5d service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:55.187071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8b8a27f6-69ef-432d-b210-72c4160c2d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:55.202881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a27f6-69ef-432d-b210-72c4160c2d5d service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:55.205400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf955208-c6d1-4ba9-9b98-434ecdf62046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:55.206939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf955208-c6d1-4ba9-9b98-434ecdf62046 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:55.208160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:55.209036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:55.209313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:55.209589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] PATH_INFO: `/v3/projects/4580d7307e1641cbb1896843df075e54` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:55.212345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4580d7307e1641cbb1896843df075e54)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:55.214609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:55.252270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1077/2131] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:54 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:55.315434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4580d7307e1641cbb1896843df075e54', 'request_id': 'req-a51c98eb-c10e-456c-9683-5b42b834c4e5'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:55.326488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4580d7307e1641cbb1896843df075e54', 'request_id': 'req-a51c98eb-c10e-456c-9683-5b42b834c4e5'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:55.345518 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4580d7307e1641cbb1896843df075e54', 'request_id': 'req-a51c98eb-c10e-456c-9683-5b42b834c4e5'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:55.369265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] The token cache is being invalidate because project 4580d7307e1641cbb1896843df075e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:55.369602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:55.372147 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:55.374848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1055/2132] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:55 2021] DELETE /identity/v3/projects/4580d7307e1641cbb1896843df075e54 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:55.378808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf955208-c6d1-4ba9-9b98-434ecdf62046 service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:55.396235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf955208-c6d1-4ba9-9b98-434ecdf62046 service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:55.410657 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:55.413483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:55.571475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:55.572401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:55.572666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:55.572939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] PATH_INFO: `/v3/users/a9425c53fe134b58a96c7eb219a8c8e1` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:55.577061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c98eb-c10e-456c-9683-5b42b834c4e5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:55.578623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9425c53fe134b58a96c7eb219a8c8e1)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:55.580601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:55.585813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687addf-8e4e-4bc1-8b7d-edab695ed308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:55.587534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687addf-8e4e-4bc1-8b7d-edab695ed308 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:55.589264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687addf-8e4e-4bc1-8b7d-edab695ed308 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:55.589264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687addf-8e4e-4bc1-8b7d-edab695ed308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:55.595114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7687addf-8e4e-4bc1-8b7d-edab695ed308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:55.688598 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9425c53fe134b58a96c7eb219a8c8e1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:55.701514 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9425c53fe134b58a96c7eb219a8c8e1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:55.703298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9425c53fe134b58a96c7eb219a8c8e1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:55.760816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9425c53fe134b58a96c7eb219a8c8e1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:55.763825 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9425c53fe134b58a96c7eb219a8c8e1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:55.771388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687addf-8e4e-4bc1-8b7d-edab695ed308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:55.774253 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687addf-8e4e-4bc1-8b7d-edab695ed308 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:55.788837 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1056/2133] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:55 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:55.802563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687addf-8e4e-4bc1-8b7d-edab695ed308 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:55.805117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7687addf-8e4e-4bc1-8b7d-edab695ed308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:55.822046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1078/2134] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:55 2021] DELETE /identity/v3/users/a9425c53fe134b58a96c7eb219a8c8e1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:55.848953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687addf-8e4e-4bc1-8b7d-edab695ed308 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:56.065435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:56.066809 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:56.067333 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:56.068211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] PATH_INFO: `/v3/projects/c310e32a51634083a2c3c2d5975ef66b` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:56.070540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c310e32a51634083a2c3c2d5975ef66b)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:56.072795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:56.165723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c310e32a51634083a2c3c2d5975ef66b', 'request_id': 'req-8b46fc85-596c-425e-b743-8290a1a372a8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.173299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c310e32a51634083a2c3c2d5975ef66b', 'request_id': 'req-8b46fc85-596c-425e-b743-8290a1a372a8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.186497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c310e32a51634083a2c3c2d5975ef66b', 'request_id': 'req-8b46fc85-596c-425e-b743-8290a1a372a8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.205617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] The token cache is being invalidate because project c310e32a51634083a2c3c2d5975ef66b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:56.205617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.205923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.208015 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1057/2135] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:55 2021] DELETE /identity/v3/projects/c310e32a51634083a2c3c2d5975ef66b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:56.213256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:56.216586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:56.234912 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed440ce4-b6b0-4213-919f-0bc49878ab29 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:56.362528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211ce52-2e8d-4726-9388-5a089081324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:56.363772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ce52-2e8d-4726-9388-5a089081324c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:56.364342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ce52-2e8d-4726-9388-5a089081324c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:56.364626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ce52-2e8d-4726-9388-5a089081324c admin admin] PATH_INFO: `/v3/users/a1af328d2bc34833891fb2fa163e0dd4` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:56.366587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211ce52-2e8d-4726-9388-5a089081324c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1af328d2bc34833891fb2fa163e0dd4)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:56.368971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211ce52-2e8d-4726-9388-5a089081324c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:56.429610 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:56.432720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:56.441218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e211ce52-2e8d-4726-9388-5a089081324c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1af328d2bc34833891fb2fa163e0dd4'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.451045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e211ce52-2e8d-4726-9388-5a089081324c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1af328d2bc34833891fb2fa163e0dd4'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.451851 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e211ce52-2e8d-4726-9388-5a089081324c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1af328d2bc34833891fb2fa163e0dd4'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.452086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46fc85-596c-425e-b743-8290a1a372a8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:56.458433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:56.462209 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:56.464789 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:56.465076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] PATH_INFO: `/v3/projects/2e2de554132944d294ca9fc5dcf8d6d5` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:56.467076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2de554132944d294ca9fc5dcf8d6d5)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:56.470805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:56.478088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e211ce52-2e8d-4726-9388-5a089081324c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1af328d2bc34833891fb2fa163e0dd4'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.478959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e211ce52-2e8d-4726-9388-5a089081324c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1af328d2bc34833891fb2fa163e0dd4'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.496829 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1079/2136] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:37:56 2021] DELETE /identity/v3/users/a1af328d2bc34833891fb2fa163e0dd4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:56.561648 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2de554132944d294ca9fc5dcf8d6d5', 'request_id': 'req-57ffac43-8cdd-4a3c-983f-9a4c971f261f'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.569893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2de554132944d294ca9fc5dcf8d6d5', 'request_id': 'req-57ffac43-8cdd-4a3c-983f-9a4c971f261f'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.578744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2de554132944d294ca9fc5dcf8d6d5', 'request_id': 'req-57ffac43-8cdd-4a3c-983f-9a4c971f261f'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.598791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] The token cache is being invalidate because project 2e2de554132944d294ca9fc5dcf8d6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:56.599089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.600288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-57ffac43-8cdd-4a3c-983f-9a4c971f261f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:56.607289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1058/2137] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:56 2021] DELETE /identity/v3/projects/2e2de554132944d294ca9fc5dcf8d6d5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:56.609605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b579dd-5232-4b5e-bdfd-6aaf2440950e None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:56.610103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b579dd-5232-4b5e-bdfd-6aaf2440950e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:56.610281 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b579dd-5232-4b5e-bdfd-6aaf2440950e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:56.640749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d5b579dd-5232-4b5e-bdfd-6aaf2440950e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:56.642465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d5b579dd-5232-4b5e-bdfd-6aaf2440950e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:56.727103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1080/2138] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:56.734034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70403b-8837-4e7c-b2aa-f8da1c4f33dc None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:56.734313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70403b-8837-4e7c-b2aa-f8da1c4f33dc None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:56.734594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70403b-8837-4e7c-b2aa-f8da1c4f33dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:56.763092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-2f70403b-8837-4e7c-b2aa-f8da1c4f33dc None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:56.764445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2f70403b-8837-4e7c-b2aa-f8da1c4f33dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:56.782061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1059/2139] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:56.783197 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b579dd-5232-4b5e-bdfd-6aaf2440950e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:56.794706 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b579dd-5232-4b5e-bdfd-6aaf2440950e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:56.800546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00e5db-aa88-486b-8485-a95018efa0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:56.801294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00e5db-aa88-486b-8485-a95018efa0be admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:56.801648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00e5db-aa88-486b-8485-a95018efa0be admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:56.802046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00e5db-aa88-486b-8485-a95018efa0be admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:56.802884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00e5db-aa88-486b-8485-a95018efa0be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:56.804458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00e5db-aa88-486b-8485-a95018efa0be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:56.806582 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00e5db-aa88-486b-8485-a95018efa0be admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:56.826923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1081/2140] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:56.828639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70403b-8837-4e7c-b2aa-f8da1c4f33dc None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:56.859953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70403b-8837-4e7c-b2aa-f8da1c4f33dc None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:56.888920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f08f04-eead-4996-b34a-44d2aa9ede07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:56.889596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f08f04-eead-4996-b34a-44d2aa9ede07 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:56.889899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f08f04-eead-4996-b34a-44d2aa9ede07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:56.890176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f08f04-eead-4996-b34a-44d2aa9ede07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:56.890887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f08f04-eead-4996-b34a-44d2aa9ede07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:56.892782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f08f04-eead-4996-b34a-44d2aa9ede07 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:56.950720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1060/2141] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:56 2021] POST /identity/v3/projects => generated 407 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:56.952392 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00e5db-aa88-486b-8485-a95018efa0be admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:56.967361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00e5db-aa88-486b-8485-a95018efa0be admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:57.110775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2ddd-f5eb-45e6-bdca-425da7482a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:57.112292 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2ddd-f5eb-45e6-bdca-425da7482a14 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:57.112676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2ddd-f5eb-45e6-bdca-425da7482a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:57.113027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2ddd-f5eb-45e6-bdca-425da7482a14 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:57.115720 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f2ddd-f5eb-45e6-bdca-425da7482a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:57.118753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f2ddd-f5eb-45e6-bdca-425da7482a14 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:57.162800 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1082/2142] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:56 2021] POST /identity/v3/users => generated 304 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:57.164347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f08f04-eead-4996-b34a-44d2aa9ede07 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:57.179404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f08f04-eead-4996-b34a-44d2aa9ede07 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:57.190500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef802-2d23-4a27-89b1-e5dfa34dc4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:57.194612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef802-2d23-4a27-89b1-e5dfa34dc4be admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:57.195225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef802-2d23-4a27-89b1-e5dfa34dc4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:57.195802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef802-2d23-4a27-89b1-e5dfa34dc4be admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:57.197810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfef802-2d23-4a27-89b1-e5dfa34dc4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:57.200698 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfef802-2d23-4a27-89b1-e5dfa34dc4be admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:57.217569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1061/2143] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:57 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:37:57.221261 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2ddd-f5eb-45e6-bdca-425da7482a14 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:57.238056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2ddd-f5eb-45e6-bdca-425da7482a14 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:57.254624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683d262-950d-41cc-bd92-bd336f1568dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:57.255329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683d262-950d-41cc-bd92-bd336f1568dc admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:57.255612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683d262-950d-41cc-bd92-bd336f1568dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:57.255890 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683d262-950d-41cc-bd92-bd336f1568dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:57.256652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683d262-950d-41cc-bd92-bd336f1568dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:57.258296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683d262-950d-41cc-bd92-bd336f1568dc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:57.283036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1083/2144] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:57 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:57.287201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef802-2d23-4a27-89b1-e5dfa34dc4be admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:57.304037 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683d262-950d-41cc-bd92-bd336f1568dc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:57.304974 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d683d262-950d-41cc-bd92-bd336f1568dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:57.314641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef802-2d23-4a27-89b1-e5dfa34dc4be admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:57.321149 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9432abf-729c-4495-886c-612032c3e627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:57.322840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432abf-729c-4495-886c-612032c3e627 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:57.323340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432abf-729c-4495-886c-612032c3e627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:57.323613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432abf-729c-4495-886c-612032c3e627 admin admin] PATH_INFO: `/v3/projects/b9b1a2bcacb74a3295d6cb0d26518b3b/users/d9388167125f4a038a27a89acb12c62f/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:57.339112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683d262-950d-41cc-bd92-bd336f1568dc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:57.351372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:57.352776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:57.353080 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:57.353358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] PATH_INFO: `/v3/projects/d4ffc6ac5a9a4e8397e31f85d509a1c2` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:57.354658 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ffc6ac5a9a4e8397e31f85d509a1c2)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:57.356594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:57.385555 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9432abf-729c-4495-886c-612032c3e627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b1a2bcacb74a3295d6cb0d26518b3b, user_id=d9388167125f4a038a27a89acb12c62f, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:57.394638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9432abf-729c-4495-886c-612032c3e627 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:57.422133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1062/2145] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:57 2021] PUT /identity/v3/projects/b9b1a2bcacb74a3295d6cb0d26518b3b/users/d9388167125f4a038a27a89acb12c62f/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:57.434817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a426dd-2f08-4846-aecc-eaa14f7f1938 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:57.435226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a426dd-2f08-4846-aecc-eaa14f7f1938 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:57.435579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a426dd-2f08-4846-aecc-eaa14f7f1938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:57.457899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ffc6ac5a9a4e8397e31f85d509a1c2', 'request_id': 'req-040b8e5e-73c0-46cd-a655-7b2e6383debc'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:57.477887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-81a426dd-2f08-4846-aecc-eaa14f7f1938 None None] MFA Rules not processed for user `d9388167125f4a038a27a89acb12c62f`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:57.480197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-81a426dd-2f08-4846-aecc-eaa14f7f1938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:57.482866 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ffc6ac5a9a4e8397e31f85d509a1c2', 'request_id': 'req-040b8e5e-73c0-46cd-a655-7b2e6383debc'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:57.501202 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ffc6ac5a9a4e8397e31f85d509a1c2', 'request_id': 'req-040b8e5e-73c0-46cd-a655-7b2e6383debc'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:57.522211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] The token cache is being invalidate because project d4ffc6ac5a9a4e8397e31f85d509a1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:37:57.523318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:57.526185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-040b8e5e-73c0-46cd-a655-7b2e6383debc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:37:57.530284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1084/2146] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:37:57 2021] DELETE /identity/v3/projects/d4ffc6ac5a9a4e8397e31f85d509a1c2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:57.551225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1879b6-e52c-49a2-84a4-9504c758911f None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:57.551225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1879b6-e52c-49a2-84a4-9504c758911f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:57.551613 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1879b6-e52c-49a2-84a4-9504c758911f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:57.603336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1063/2147] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:57 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:57.606695 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a426dd-2f08-4846-aecc-eaa14f7f1938 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:57.609183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-81a426dd-2f08-4846-aecc-eaa14f7f1938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:57.620215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-0d1879b6-e52c-49a2-84a4-9504c758911f None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:57.635578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0d1879b6-e52c-49a2-84a4-9504c758911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:57.741313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a426dd-2f08-4846-aecc-eaa14f7f1938 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:57.756423 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125c81-ff61-4707-9e8e-ce94bbfc7696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:57.757108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125c81-ff61-4707-9e8e-ce94bbfc7696 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:57.757389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125c81-ff61-4707-9e8e-ce94bbfc7696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:57.757662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125c81-ff61-4707-9e8e-ce94bbfc7696 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:57.758442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca125c81-ff61-4707-9e8e-ce94bbfc7696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:57.763525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca125c81-ff61-4707-9e8e-ce94bbfc7696 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:57.783921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1085/2148] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:57.790856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829bff1-16b2-45f2-9ffe-9619993f7ea3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:57.791408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829bff1-16b2-45f2-9ffe-9619993f7ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:57.791849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829bff1-16b2-45f2-9ffe-9619993f7ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:57.824096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1064/2149] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:57 2021] POST /identity/v3/projects => generated 407 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:57.827955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125c81-ff61-4707-9e8e-ce94bbfc7696 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:57.848377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-b829bff1-16b2-45f2-9ffe-9619993f7ea3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:57.849611 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b829bff1-16b2-45f2-9ffe-9619993f7ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:58.014374 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125c81-ff61-4707-9e8e-ce94bbfc7696 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:58.027861 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde8857-9ee7-4119-843d-fa1dbcc85312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:58.030362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde8857-9ee7-4119-843d-fa1dbcc85312 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.034131 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1086/2150] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:58.039486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829bff1-16b2-45f2-9ffe-9619993f7ea3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:58.042335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde8857-9ee7-4119-843d-fa1dbcc85312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.042931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde8857-9ee7-4119-843d-fa1dbcc85312 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.046367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde8857-9ee7-4119-843d-fa1dbcc85312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:58.055289 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde8857-9ee7-4119-843d-fa1dbcc85312 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:58.062682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829bff1-16b2-45f2-9ffe-9619993f7ea3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:58.093056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ea964-bec0-40b9-a6bb-fff585c1a136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:58.093738 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ea964-bec0-40b9-a6bb-fff585c1a136 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.094047 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ea964-bec0-40b9-a6bb-fff585c1a136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.094397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ea964-bec0-40b9-a6bb-fff585c1a136 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.095205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ea964-bec0-40b9-a6bb-fff585c1a136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:37:58.095458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ea964-bec0-40b9-a6bb-fff585c1a136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:58.096056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1065/2151] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:57 2021] POST /identity/v3/users => generated 310 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:37:58.097442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ea964-bec0-40b9-a6bb-fff585c1a136 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:58.100218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde8857-9ee7-4119-843d-fa1dbcc85312 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:58.122804 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1087/2152] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:37:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:37:58.127412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ea964-bec0-40b9-a6bb-fff585c1a136 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:58.130355 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde8857-9ee7-4119-843d-fa1dbcc85312 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:58.145202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a21a2d-3b83-4862-b206-f68b54d5b787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:58.145941 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21a2d-3b83-4862-b206-f68b54d5b787 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.146571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21a2d-3b83-4862-b206-f68b54d5b787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.146571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21a2d-3b83-4862-b206-f68b54d5b787 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.147241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a21a2d-3b83-4862-b206-f68b54d5b787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:58.148118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ea964-bec0-40b9-a6bb-fff585c1a136 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:58.151299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a21a2d-3b83-4862-b206-f68b54d5b787 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:58.162638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09ff02-641a-437c-adb2-0299ac8ea4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:58.163368 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ff02-641a-437c-adb2-0299ac8ea4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.163657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ff02-641a-437c-adb2-0299ac8ea4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.163933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ff02-641a-437c-adb2-0299ac8ea4c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.170402 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09ff02-641a-437c-adb2-0299ac8ea4c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:58.172670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09ff02-641a-437c-adb2-0299ac8ea4c6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:58.184594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1066/2153] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:58 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:58.185628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a21a2d-3b83-4862-b206-f68b54d5b787 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:58.208071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a21a2d-3b83-4862-b206-f68b54d5b787 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:58.222894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730c33a-bf12-40af-b04f-504dfaedee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:58.223819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730c33a-bf12-40af-b04f-504dfaedee88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.224137 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730c33a-bf12-40af-b04f-504dfaedee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.224356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730c33a-bf12-40af-b04f-504dfaedee88 admin admin] PATH_INFO: `/v3/projects/7de4525c9c7d42339f888c28713f126c/users/2c4c46a0d0c24d629eac650f6b7a26a4/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.238176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1088/2154] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:58 2021] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:58.247730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09ff02-641a-437c-adb2-0299ac8ea4c6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:58.257002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730c33a-bf12-40af-b04f-504dfaedee88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de4525c9c7d42339f888c28713f126c, user_id=2c4c46a0d0c24d629eac650f6b7a26a4, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:58.260232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730c33a-bf12-40af-b04f-504dfaedee88 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:58.288178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1067/2155] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:58 2021] PUT /identity/v3/projects/7de4525c9c7d42339f888c28713f126c/users/2c4c46a0d0c24d629eac650f6b7a26a4/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:58.289049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730c33a-bf12-40af-b04f-504dfaedee88 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:58.418528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09ff02-641a-437c-adb2-0299ac8ea4c6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:58.441039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b01f81-97f2-48d6-8eb5-2492bab604b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:58.441738 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b01f81-97f2-48d6-8eb5-2492bab604b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.442046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b01f81-97f2-48d6-8eb5-2492bab604b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.442323 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b01f81-97f2-48d6-8eb5-2492bab604b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.443452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b01f81-97f2-48d6-8eb5-2492bab604b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:58.446522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730c33a-bf12-40af-b04f-504dfaedee88 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:58.463656 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b01f81-97f2-48d6-8eb5-2492bab604b6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:58.487218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea4cb4-25e0-4c2e-8505-b870b7219cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:58.487841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea4cb4-25e0-4c2e-8505-b870b7219cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.488510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea4cb4-25e0-4c2e-8505-b870b7219cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.488646 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea4cb4-25e0-4c2e-8505-b870b7219cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.489548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea4cb4-25e0-4c2e-8505-b870b7219cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:58.499228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea4cb4-25e0-4c2e-8505-b870b7219cb4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:58.527996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1089/2156] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:58 2021] POST /identity/v3/users => generated 296 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:58.528919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b01f81-97f2-48d6-8eb5-2492bab604b6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:58.538882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1068/2157] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:58 2021] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:58.542690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea4cb4-25e0-4c2e-8505-b870b7219cb4 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:58.563799 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b01f81-97f2-48d6-8eb5-2492bab604b6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:58.573251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea4cb4-25e0-4c2e-8505-b870b7219cb4 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:58.584789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9ac87-19b8-4609-84d6-43c245102977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:58.585485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9ac87-19b8-4609-84d6-43c245102977 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.585789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9ac87-19b8-4609-84d6-43c245102977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.586077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9ac87-19b8-4609-84d6-43c245102977 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.586888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9ac87-19b8-4609-84d6-43c245102977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:58.588526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9ac87-19b8-4609-84d6-43c245102977 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:58.602676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209b9b6-445b-47be-bcca-31821f80d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:58.603589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b9b6-445b-47be-bcca-31821f80d1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.603871 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b9b6-445b-47be-bcca-31821f80d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.604149 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b9b6-445b-47be-bcca-31821f80d1fe admin admin] PATH_INFO: `/v3/projects/7de4525c9c7d42339f888c28713f126c/users/2c4c46a0d0c24d629eac650f6b7a26a4/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.617392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209b9b6-445b-47be-bcca-31821f80d1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de4525c9c7d42339f888c28713f126c, user_id=2c4c46a0d0c24d629eac650f6b7a26a4, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:58.623007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209b9b6-445b-47be-bcca-31821f80d1fe admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:58.634206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1090/2158] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:58 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:58.640472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9ac87-19b8-4609-84d6-43c245102977 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:58.646498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1069/2159] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:58 2021] PUT /identity/v3/projects/7de4525c9c7d42339f888c28713f126c/users/2c4c46a0d0c24d629eac650f6b7a26a4/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:37:58.657385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5341c94-637d-4aab-98e4-4056369811ac None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.657664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5341c94-637d-4aab-98e4-4056369811ac None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.657989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5341c94-637d-4aab-98e4-4056369811ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.663915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9ac87-19b8-4609-84d6-43c245102977 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:58.755983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c5341c94-637d-4aab-98e4-4056369811ac None None] MFA Rules not processed for user `2c4c46a0d0c24d629eac650f6b7a26a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:58.757352 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c5341c94-637d-4aab-98e4-4056369811ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:58.818712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf844a-5a64-4a09-98c8-6e9fe8541f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:58.819395 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf844a-5a64-4a09-98c8-6e9fe8541f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.819684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf844a-5a64-4a09-98c8-6e9fe8541f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.819961 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf844a-5a64-4a09-98c8-6e9fe8541f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.820717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf844a-5a64-4a09-98c8-6e9fe8541f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:58.822517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf844a-5a64-4a09-98c8-6e9fe8541f5f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:58.848562 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1091/2160] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:58 2021] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:58.849501 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf844a-5a64-4a09-98c8-6e9fe8541f5f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:58.875049 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf844a-5a64-4a09-98c8-6e9fe8541f5f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:58.884726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd410a4f-f3c5-4955-9a8f-6eb14a310d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:58.885633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd410a4f-f3c5-4955-9a8f-6eb14a310d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.885939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd410a4f-f3c5-4955-9a8f-6eb14a310d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.886218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd410a4f-f3c5-4955-9a8f-6eb14a310d11 admin admin] PATH_INFO: `/v3/projects/3ae81ac49dbc413bbad34aa66c10913a/users/1e893f030de343e59f4210d039a60a4b/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:58.922659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd410a4f-f3c5-4955-9a8f-6eb14a310d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae81ac49dbc413bbad34aa66c10913a, user_id=1e893f030de343e59f4210d039a60a4b, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:58.927300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd410a4f-f3c5-4955-9a8f-6eb14a310d11 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:58.932922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1070/2161] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:58 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:37:58.945196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5341c94-637d-4aab-98e4-4056369811ac None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:58.946892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c5341c94-637d-4aab-98e4-4056369811ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:58.963055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1092/2162] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:58 2021] PUT /identity/v3/projects/3ae81ac49dbc413bbad34aa66c10913a/users/1e893f030de343e59f4210d039a60a4b/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:58.976845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7af41a-a4f0-4a6e-bad2-d158e8c76b0e None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:58.978043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7af41a-a4f0-4a6e-bad2-d158e8c76b0e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:58.978043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7af41a-a4f0-4a6e-bad2-d158e8c76b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:59.045046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-0f7af41a-a4f0-4a6e-bad2-d158e8c76b0e None None] MFA Rules not processed for user `1e893f030de343e59f4210d039a60a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:37:59.046403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0f7af41a-a4f0-4a6e-bad2-d158e8c76b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:37:59.050993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5341c94-637d-4aab-98e4-4056369811ac None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:59.169711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84555f-cae4-49f4-82e0-b1f060361a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:59.170547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84555f-cae4-49f4-82e0-b1f060361a75 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:59.170870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84555f-cae4-49f4-82e0-b1f060361a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:59.171148 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84555f-cae4-49f4-82e0-b1f060361a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:59.171639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1093/2163] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:58 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:37:59.177522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7af41a-a4f0-4a6e-bad2-d158e8c76b0e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:59.280114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7af41a-a4f0-4a6e-bad2-d158e8c76b0e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:59.302869 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6614dc5-c823-4ff4-966b-b98254cd5f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:59.303756 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6614dc5-c823-4ff4-966b-b98254cd5f57 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:59.304097 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6614dc5-c823-4ff4-966b-b98254cd5f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:59.304775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6614dc5-c823-4ff4-966b-b98254cd5f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:59.309406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6614dc5-c823-4ff4-966b-b98254cd5f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:59.327523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6614dc5-c823-4ff4-966b-b98254cd5f57 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:59.329250 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84555f-cae4-49f4-82e0-b1f060361a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:59.330976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84555f-cae4-49f4-82e0-b1f060361a75 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:59.345081 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1071/2164] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:58 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:37:59.415822 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1094/2165] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:37:59 2021] POST /identity/v3/projects => generated 391 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:59.421045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84555f-cae4-49f4-82e0-b1f060361a75 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:59.461262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84555f-cae4-49f4-82e0-b1f060361a75 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:59.564835 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac8b7-78b5-4c73-8342-d1f800d8549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:59.567411 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac8b7-78b5-4c73-8342-d1f800d8549c admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:59.570084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac8b7-78b5-4c73-8342-d1f800d8549c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:59.570431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac8b7-78b5-4c73-8342-d1f800d8549c admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:59.572563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dac8b7-78b5-4c73-8342-d1f800d8549c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:59.576495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dac8b7-78b5-4c73-8342-d1f800d8549c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:59.631746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1072/2166] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:37:59 2021] POST /identity/v3/users => generated 302 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:37:59.631914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6614dc5-c823-4ff4-966b-b98254cd5f57 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:59.647920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac8b7-78b5-4c73-8342-d1f800d8549c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:59.653190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6614dc5-c823-4ff4-966b-b98254cd5f57 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:59.664000 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63b4e3-bc48-49fe-ac48-353b46f636c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:59.665183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63b4e3-bc48-49fe-ac48-353b46f636c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:59.665541 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63b4e3-bc48-49fe-ac48-353b46f636c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:59.666430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63b4e3-bc48-49fe-ac48-353b46f636c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:59.667373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63b4e3-bc48-49fe-ac48-353b46f636c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:59.672051 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63b4e3-bc48-49fe-ac48-353b46f636c3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:59.690238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1095/2167] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:59 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:59.691431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63b4e3-bc48-49fe-ac48-353b46f636c3 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:59.708531 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63b4e3-bc48-49fe-ac48-353b46f636c3 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:59.715990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11406569-8227-4f37-91cb-0a3c62b0f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:59.717270 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11406569-8227-4f37-91cb-0a3c62b0f5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:59.717648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11406569-8227-4f37-91cb-0a3c62b0f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:59.718072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11406569-8227-4f37-91cb-0a3c62b0f5ec admin admin] PATH_INFO: `/v3/projects/3f8d188272aa4bdea7244bc5c37a1cfa/users/96848864b18346b1b1743719b588aca9/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:59.762733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11406569-8227-4f37-91cb-0a3c62b0f5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8d188272aa4bdea7244bc5c37a1cfa, user_id=96848864b18346b1b1743719b588aca9, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:59.773109 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11406569-8227-4f37-91cb-0a3c62b0f5ec admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:59.779500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac8b7-78b5-4c73-8342-d1f800d8549c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:59.794242 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83b351-c7fc-48ab-a9f2-34e92d7fca74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:59.794955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83b351-c7fc-48ab-a9f2-34e92d7fca74 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:59.795218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83b351-c7fc-48ab-a9f2-34e92d7fca74 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:59.795496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83b351-c7fc-48ab-a9f2-34e92d7fca74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:59.816982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1096/2168] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:37:59 2021] PUT /identity/v3/projects/3f8d188272aa4bdea7244bc5c37a1cfa/users/96848864b18346b1b1743719b588aca9/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:37:59.822750 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11406569-8227-4f37-91cb-0a3c62b0f5ec admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:37:59.954695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11406569-8227-4f37-91cb-0a3c62b0f5ec admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:37:59.960387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74caac-4427-4428-aed2-e0c6c4066dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:37:59.961276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74caac-4427-4428-aed2-e0c6c4066dad admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:59.961863 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74caac-4427-4428-aed2-e0c6c4066dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:59.962278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74caac-4427-4428-aed2-e0c6c4066dad admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:59.963183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74caac-4427-4428-aed2-e0c6c4066dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:37:59.965092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74caac-4427-4428-aed2-e0c6c4066dad admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:37:59.982922 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1097/2169] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:37:59 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:37:59.984616 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82e38a-0fb8-4774-b721-9cabcafcd370 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:37:59.984982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82e38a-0fb8-4774-b721-9cabcafcd370 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:37:59.985358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82e38a-0fb8-4774-b721-9cabcafcd370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:37:59.997886 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83b351-c7fc-48ab-a9f2-34e92d7fca74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:00.000083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83b351-c7fc-48ab-a9f2-34e92d7fca74 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:00.018050 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1073/2170] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:37:59 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:38:00.020399 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83b351-c7fc-48ab-a9f2-34e92d7fca74 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:00.043525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83b351-c7fc-48ab-a9f2-34e92d7fca74 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:00.046432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-4a82e38a-0fb8-4774-b721-9cabcafcd370 None None] MFA Rules not processed for user `7e3a3afdfc4c44a29d0f3df50a5ed2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:00.060306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4a82e38a-0fb8-4774-b721-9cabcafcd370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:00.061197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8affc-5f33-4735-a407-e9475b5a68ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:00.062162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8affc-5f33-4735-a407-e9475b5a68ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:00.062444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8affc-5f33-4735-a407-e9475b5a68ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:00.062722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8affc-5f33-4735-a407-e9475b5a68ac admin admin] PATH_INFO: `/v3/projects/3f8d188272aa4bdea7244bc5c37a1cfa/users/96848864b18346b1b1743719b588aca9/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:00.070159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8affc-5f33-4735-a407-e9475b5a68ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8d188272aa4bdea7244bc5c37a1cfa, user_id=96848864b18346b1b1743719b588aca9, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:00.073550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8affc-5f33-4735-a407-e9475b5a68ac admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:00.120022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1074/2171] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:00 2021] PUT /identity/v3/projects/3f8d188272aa4bdea7244bc5c37a1cfa/users/96848864b18346b1b1743719b588aca9/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:00.132472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1f1ff-160e-42cd-af14-d8f44fd9ed98 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:00.132765 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1f1ff-160e-42cd-af14-d8f44fd9ed98 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:00.133037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1f1ff-160e-42cd-af14-d8f44fd9ed98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:00.244221 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-bed1f1ff-160e-42cd-af14-d8f44fd9ed98 None None] MFA Rules not processed for user `96848864b18346b1b1743719b588aca9`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:00.245170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-bed1f1ff-160e-42cd-af14-d8f44fd9ed98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:00.303734 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1098/2172] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:37:59 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:00.309621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82e38a-0fb8-4774-b721-9cabcafcd370 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:00.324556 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4a82e38a-0fb8-4774-b721-9cabcafcd370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:00.375500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82e38a-0fb8-4774-b721-9cabcafcd370 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:00.490233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1075/2173] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:00 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:00.574820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518415-4a73-41c9-a5a5-28c21f150c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:00.575764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518415-4a73-41c9-a5a5-28c21f150c24 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:00.576047 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518415-4a73-41c9-a5a5-28c21f150c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:00.576342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518415-4a73-41c9-a5a5-28c21f150c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:00.577060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2518415-4a73-41c9-a5a5-28c21f150c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:00.582398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2518415-4a73-41c9-a5a5-28c21f150c24 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:00.635291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1099/2174] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:00 2021] POST /identity/v3/projects => generated 379 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:00.639957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1f1ff-160e-42cd-af14-d8f44fd9ed98 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:00.659209 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1f1ff-160e-42cd-af14-d8f44fd9ed98 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:00.828101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e6460-c9c7-4563-8afc-1e8cb22e6111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:00.830063 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e6460-c9c7-4563-8afc-1e8cb22e6111 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:00.830345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e6460-c9c7-4563-8afc-1e8cb22e6111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:00.830617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e6460-c9c7-4563-8afc-1e8cb22e6111 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:00.831393 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e6460-c9c7-4563-8afc-1e8cb22e6111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:00.836898 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e6460-c9c7-4563-8afc-1e8cb22e6111 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:00.894609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1076/2175] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:00 2021] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:38:00.899158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518415-4a73-41c9-a5a5-28c21f150c24 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:00.914324 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518415-4a73-41c9-a5a5-28c21f150c24 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:00.932864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366cf1b-9ced-4ec7-97c1-8bfb8d17fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:00.933654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366cf1b-9ced-4ec7-97c1-8bfb8d17fbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:00.934765 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366cf1b-9ced-4ec7-97c1-8bfb8d17fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:00.935078 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366cf1b-9ced-4ec7-97c1-8bfb8d17fbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:00.935845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366cf1b-9ced-4ec7-97c1-8bfb8d17fbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:00.938059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366cf1b-9ced-4ec7-97c1-8bfb8d17fbb8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:00.957409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1100/2176] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:00 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:38:00.961453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e6460-c9c7-4563-8afc-1e8cb22e6111 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:00.976235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e6460-c9c7-4563-8afc-1e8cb22e6111 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:00.983666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2c11e-4a2c-4aa7-8f5e-7323830ad3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:00.984388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2c11e-4a2c-4aa7-8f5e-7323830ad3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:00.984670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2c11e-4a2c-4aa7-8f5e-7323830ad3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:00.985410 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2c11e-4a2c-4aa7-8f5e-7323830ad3e9 admin admin] PATH_INFO: `/v3/projects/9625cc6c79ee42cca4b0b0cc8cd55db6/users/1342900282fd4bdcaac541eaa6a3834b/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:01.007317 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2c11e-4a2c-4aa7-8f5e-7323830ad3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9625cc6c79ee42cca4b0b0cc8cd55db6, user_id=1342900282fd4bdcaac541eaa6a3834b, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:01.011321 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2c11e-4a2c-4aa7-8f5e-7323830ad3e9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:01.038339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1077/2177] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:00 2021] PUT /identity/v3/projects/9625cc6c79ee42cca4b0b0cc8cd55db6/users/1342900282fd4bdcaac541eaa6a3834b/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:38:01.040516 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366cf1b-9ced-4ec7-97c1-8bfb8d17fbb8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:01.043280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0366cf1b-9ced-4ec7-97c1-8bfb8d17fbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:01.043434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2c11e-4a2c-4aa7-8f5e-7323830ad3e9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:01.167534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366cf1b-9ced-4ec7-97c1-8bfb8d17fbb8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:01.177376 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2c11e-4a2c-4aa7-8f5e-7323830ad3e9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:01.189521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095529e6-6b3b-4a36-9aed-a6a4ef1b4a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:01.190964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095529e6-6b3b-4a36-9aed-a6a4ef1b4a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:01.191432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095529e6-6b3b-4a36-9aed-a6a4ef1b4a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:01.191884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095529e6-6b3b-4a36-9aed-a6a4ef1b4a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:01.193071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095529e6-6b3b-4a36-9aed-a6a4ef1b4a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:01.197020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095529e6-6b3b-4a36-9aed-a6a4ef1b4a45 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:01.222901 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1078/2178] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:01 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:01.224766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095529e6-6b3b-4a36-9aed-a6a4ef1b4a45 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:01.245126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095529e6-6b3b-4a36-9aed-a6a4ef1b4a45 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:01.251828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884c36e-1527-4eb9-ae48-99016cc0cad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:01.252726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c36e-1527-4eb9-ae48-99016cc0cad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:01.253026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c36e-1527-4eb9-ae48-99016cc0cad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:01.253280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c36e-1527-4eb9-ae48-99016cc0cad1 admin admin] PATH_INFO: `/v3/projects/9625cc6c79ee42cca4b0b0cc8cd55db6/users/1342900282fd4bdcaac541eaa6a3834b/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:01.256365 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884c36e-1527-4eb9-ae48-99016cc0cad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9625cc6c79ee42cca4b0b0cc8cd55db6, user_id=1342900282fd4bdcaac541eaa6a3834b, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:01.261302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884c36e-1527-4eb9-ae48-99016cc0cad1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:01.278768 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be37e62-1a40-455d-91f9-1123273ed087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:01.279299 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be37e62-1a40-455d-91f9-1123273ed087 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:01.279579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be37e62-1a40-455d-91f9-1123273ed087 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:01.279848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be37e62-1a40-455d-91f9-1123273ed087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:01.283465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1079/2179] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:01 2021] PUT /identity/v3/projects/9625cc6c79ee42cca4b0b0cc8cd55db6/users/1342900282fd4bdcaac541eaa6a3834b/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:01.360397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be37e62-1a40-455d-91f9-1123273ed087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:01.361923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be37e62-1a40-455d-91f9-1123273ed087 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:01.374931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1101/2180] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:01 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:01.574836 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884c36e-1527-4eb9-ae48-99016cc0cad1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:01.694482 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884c36e-1527-4eb9-ae48-99016cc0cad1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:01.700821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b89b4-53c0-4768-bfa5-0572a7272dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:01.701774 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b89b4-53c0-4768-bfa5-0572a7272dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:01.702243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b89b4-53c0-4768-bfa5-0572a7272dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:01.702597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b89b4-53c0-4768-bfa5-0572a7272dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:01.793646 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b89b4-53c0-4768-bfa5-0572a7272dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:01.795395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b89b4-53c0-4768-bfa5-0572a7272dd2 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:01.810160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1080/2181] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:01 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:06.589977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f44016-d541-41a0-93cd-2987b8962148 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:06.590460 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f44016-d541-41a0-93cd-2987b8962148 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:06.590666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f44016-d541-41a0-93cd-2987b8962148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:06.621617 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-69f44016-d541-41a0-93cd-2987b8962148 None None] MFA Rules not processed for user `1342900282fd4bdcaac541eaa6a3834b`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:06.623750 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-69f44016-d541-41a0-93cd-2987b8962148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:06.740092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1102/2182] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:06 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:06.752518 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b89b4-53c0-4768-bfa5-0572a7272dd2 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:06.753970 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4f6b89b4-53c0-4768-bfa5-0572a7272dd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:06.846590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b89b4-53c0-4768-bfa5-0572a7272dd2 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:06.853878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ae97c-9c84-477a-ac94-9f5fb3db0ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:06.854691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ae97c-9c84-477a-ac94-9f5fb3db0ced service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:06.855033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ae97c-9c84-477a-ac94-9f5fb3db0ced service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:06.855478 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ae97c-9c84-477a-ac94-9f5fb3db0ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:06.912560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ae97c-9c84-477a-ac94-9f5fb3db0ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:06.914193 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ae97c-9c84-477a-ac94-9f5fb3db0ced service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:06.924650 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1081/2183] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:06 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:11.225262 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f44016-d541-41a0-93cd-2987b8962148 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:11.303212 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f44016-d541-41a0-93cd-2987b8962148 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:11.308909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:11.310074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:11.310500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:11.310918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] PATH_INFO: `/v3/users/d9388167125f4a038a27a89acb12c62f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:11.312785 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9388167125f4a038a27a89acb12c62f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:11.317778 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:11.370437 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9388167125f4a038a27a89acb12c62f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.378949 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9388167125f4a038a27a89acb12c62f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.379727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9388167125f4a038a27a89acb12c62f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.392307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9388167125f4a038a27a89acb12c62f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.393031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9388167125f4a038a27a89acb12c62f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:11.407532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1103/2184] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:11 2021] DELETE /identity/v3/users/d9388167125f4a038a27a89acb12c62f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:11.412085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8556b-2415-452a-8759-45f13cc47234 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:11.412608 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8556b-2415-452a-8759-45f13cc47234 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:11.412608 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8556b-2415-452a-8759-45f13cc47234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:11.431782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-85a8556b-2415-452a-8759-45f13cc47234 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:11.433229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-85a8556b-2415-452a-8759-45f13cc47234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:11.526519 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1082/2185] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:11.536745 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:11.538536 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:11.606261 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2814f9-5e4a-4be6-8d24-694654f75fcd admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:11.612659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2606bb4-747c-4159-8c77-64688f1821ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:11.612659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2606bb4-747c-4159-8c77-64688f1821ea service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:11.612659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2606bb4-747c-4159-8c77-64688f1821ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:11.612659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2606bb4-747c-4159-8c77-64688f1821ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:11.623225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2606bb4-747c-4159-8c77-64688f1821ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:11.624702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2606bb4-747c-4159-8c77-64688f1821ea service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:11.635558 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1104/2186] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:12.096508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8556b-2415-452a-8759-45f13cc47234 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:12.103968 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-85a8556b-2415-452a-8759-45f13cc47234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:12.119655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c387-acf7-4904-bd0b-ac03bb8958b4 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:12.119944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c387-acf7-4904-bd0b-ac03bb8958b4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:12.120226 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c387-acf7-4904-bd0b-ac03bb8958b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:12.141712 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8556b-2415-452a-8759-45f13cc47234 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:12.161346 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-0b86c387-acf7-4904-bd0b-ac03bb8958b4 None None] MFA Rules not processed for user `66780c2cebcd40cfa78589c9b4cd4622`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:12.162787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0b86c387-acf7-4904-bd0b-ac03bb8958b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:12.188437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd3eae-b98a-497d-8f62-d3f119a5d403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:12.191101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3eae-b98a-497d-8f62-d3f119a5d403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:12.191729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3eae-b98a-497d-8f62-d3f119a5d403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:12.193205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3eae-b98a-497d-8f62-d3f119a5d403 admin admin] PATH_INFO: `/v3/users/1e893f030de343e59f4210d039a60a4b` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:12.198260 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd3eae-b98a-497d-8f62-d3f119a5d403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e893f030de343e59f4210d039a60a4b)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:12.205339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd3eae-b98a-497d-8f62-d3f119a5d403 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:12.296206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1105/2187] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:12 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:12.297882 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86c387-acf7-4904-bd0b-ac03bb8958b4 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:12.299471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0b86c387-acf7-4904-bd0b-ac03bb8958b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:12.312609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3ffd3eae-b98a-497d-8f62-d3f119a5d403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e893f030de343e59f4210d039a60a4b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.316603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86c387-acf7-4904-bd0b-ac03bb8958b4 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:12.325344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:12.326438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3ffd3eae-b98a-497d-8f62-d3f119a5d403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e893f030de343e59f4210d039a60a4b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.327150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:12.327675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:12.328209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] PATH_INFO: `/v3/projects/b9b1a2bcacb74a3295d6cb0d26518b3b` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:12.334044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b1a2bcacb74a3295d6cb0d26518b3b)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:12.336341 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:12.338630 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3ffd3eae-b98a-497d-8f62-d3f119a5d403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e893f030de343e59f4210d039a60a4b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.358893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3ffd3eae-b98a-497d-8f62-d3f119a5d403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e893f030de343e59f4210d039a60a4b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.360350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3ffd3eae-b98a-497d-8f62-d3f119a5d403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e893f030de343e59f4210d039a60a4b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.383127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1083/2188] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:12 2021] DELETE /identity/v3/users/1e893f030de343e59f4210d039a60a4b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:12.393137 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1f1da-9f4c-4c29-b6d8-3262e5f14b36 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:12.393929 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1f1da-9f4c-4c29-b6d8-3262e5f14b36 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:12.395656 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1f1da-9f4c-4c29-b6d8-3262e5f14b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:12.447243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-54c1f1da-9f4c-4c29-b6d8-3262e5f14b36 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:12.453967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b1a2bcacb74a3295d6cb0d26518b3b', 'request_id': 'req-b0c2bde9-76a0-405a-a14a-43337d6de56b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.454281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-54c1f1da-9f4c-4c29-b6d8-3262e5f14b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:12.472870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b1a2bcacb74a3295d6cb0d26518b3b', 'request_id': 'req-b0c2bde9-76a0-405a-a14a-43337d6de56b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.498445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b1a2bcacb74a3295d6cb0d26518b3b', 'request_id': 'req-b0c2bde9-76a0-405a-a14a-43337d6de56b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.529120 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] The token cache is being invalidate because project b9b1a2bcacb74a3295d6cb0d26518b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:12.529404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.530297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.535448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1106/2189] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:12 2021] DELETE /identity/v3/projects/b9b1a2bcacb74a3295d6cb0d26518b3b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:12.536780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:12.539204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:12.567843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1084/2190] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:12.569566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1f1da-9f4c-4c29-b6d8-3262e5f14b36 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:12.573457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-54c1f1da-9f4c-4c29-b6d8-3262e5f14b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:12.590753 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1f1da-9f4c-4c29-b6d8-3262e5f14b36 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:12.597234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:12.598249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:12.598623 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:12.598992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] PATH_INFO: `/v3/users/2c4c46a0d0c24d629eac650f6b7a26a4` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:12.600537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4c46a0d0c24d629eac650f6b7a26a4)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:12.602896 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:12.642650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2bde9-76a0-405a-a14a-43337d6de56b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:12.653259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49928ab7-4230-498d-b4fa-e17955662b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:12.655218 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49928ab7-4230-498d-b4fa-e17955662b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:12.656399 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49928ab7-4230-498d-b4fa-e17955662b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:12.656938 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49928ab7-4230-498d-b4fa-e17955662b54 admin admin] PATH_INFO: `/v3/users/e4939b1619fa4abbaaf1e128e643278c` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:12.659245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49928ab7-4230-498d-b4fa-e17955662b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4939b1619fa4abbaaf1e128e643278c)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:12.662193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49928ab7-4230-498d-b4fa-e17955662b54 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:12.676627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4c46a0d0c24d629eac650f6b7a26a4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.687193 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4c46a0d0c24d629eac650f6b7a26a4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.703062 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4c46a0d0c24d629eac650f6b7a26a4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.721476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4c46a0d0c24d629eac650f6b7a26a4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.722682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4c46a0d0c24d629eac650f6b7a26a4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.730112 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1085/2191] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:12 2021] DELETE /identity/v3/users/2c4c46a0d0c24d629eac650f6b7a26a4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:12.731359 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:12.750363 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:12.767560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-49928ab7-4230-498d-b4fa-e17955662b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4939b1619fa4abbaaf1e128e643278c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.785233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-49928ab7-4230-498d-b4fa-e17955662b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4939b1619fa4abbaaf1e128e643278c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.786279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-49928ab7-4230-498d-b4fa-e17955662b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4939b1619fa4abbaaf1e128e643278c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.833411 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-49928ab7-4230-498d-b4fa-e17955662b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4939b1619fa4abbaaf1e128e643278c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.834758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-49928ab7-4230-498d-b4fa-e17955662b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4939b1619fa4abbaaf1e128e643278c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:12.862040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1107/2192] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:12 2021] DELETE /identity/v3/users/e4939b1619fa4abbaaf1e128e643278c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:12.866384 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28bb28-6bc7-4b4b-a811-8ec22e86721d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:12.867020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28bb28-6bc7-4b4b-a811-8ec22e86721d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:12.867445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28bb28-6bc7-4b4b-a811-8ec22e86721d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:12.892003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4c4bc-2a83-44a2-ad9c-6002b9fc389e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:12.904241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-9d28bb28-6bc7-4b4b-a811-8ec22e86721d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:12.907339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9d28bb28-6bc7-4b4b-a811-8ec22e86721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:12.976081 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dabea-cf74-4a48-9856-8601606cfe34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:12.976765 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dabea-cf74-4a48-9856-8601606cfe34 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:12.978113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dabea-cf74-4a48-9856-8601606cfe34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:12.978390 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dabea-cf74-4a48-9856-8601606cfe34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:12.985127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e26dabea-cf74-4a48-9856-8601606cfe34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:13.037901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1108/2193] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:13.054083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28bb28-6bc7-4b4b-a811-8ec22e86721d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:13.056243 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9d28bb28-6bc7-4b4b-a811-8ec22e86721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:13.069881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28bb28-6bc7-4b4b-a811-8ec22e86721d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:13.074916 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f01c3-5d2b-4c5e-9b4e-26e2f6360f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:13.075575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f01c3-5d2b-4c5e-9b4e-26e2f6360f6d service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:13.076105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f01c3-5d2b-4c5e-9b4e-26e2f6360f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:13.076388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f01c3-5d2b-4c5e-9b4e-26e2f6360f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:13.094055 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f01c3-5d2b-4c5e-9b4e-26e2f6360f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:13.096009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f01c3-5d2b-4c5e-9b4e-26e2f6360f6d service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:13.116990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dabea-cf74-4a48-9856-8601606cfe34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:13.118327 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dabea-cf74-4a48-9856-8601606cfe34 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:13.126457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1109/2194] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:38:13.138805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1086/2195] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:13.206690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f01c3-5d2b-4c5e-9b4e-26e2f6360f6d service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:13.208284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d83f01c3-5d2b-4c5e-9b4e-26e2f6360f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:13.226289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f01c3-5d2b-4c5e-9b4e-26e2f6360f6d service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:13.247598 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:13.248652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:13.249252 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:13.251562 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] PATH_INFO: `/v3/projects/7de4525c9c7d42339f888c28713f126c` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:13.268577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de4525c9c7d42339f888c28713f126c)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:13.272073 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:13.359057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de4525c9c7d42339f888c28713f126c', 'request_id': 'req-46896d9b-946a-4128-8871-2b8a91854a1f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:13.367313 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de4525c9c7d42339f888c28713f126c', 'request_id': 'req-46896d9b-946a-4128-8871-2b8a91854a1f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:13.377489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de4525c9c7d42339f888c28713f126c', 'request_id': 'req-46896d9b-946a-4128-8871-2b8a91854a1f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:13.390764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] The token cache is being invalidate because project 7de4525c9c7d42339f888c28713f126c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:13.392404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:13.395482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-46896d9b-946a-4128-8871-2b8a91854a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:13.400260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1110/2196] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:13 2021] DELETE /identity/v3/projects/7de4525c9c7d42339f888c28713f126c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:13.406699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad6755-e814-4247-9feb-2e4a165caeba None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:13.407096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad6755-e814-4247-9feb-2e4a165caeba None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:13.407440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad6755-e814-4247-9feb-2e4a165caeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:13.431156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-9bad6755-e814-4247-9feb-2e4a165caeba None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:13.433705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9bad6755-e814-4247-9feb-2e4a165caeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:13.521600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1087/2197] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:38:13.529481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd2bcc-dc20-459b-b851-c24bda63579c None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:13.530085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd2bcc-dc20-459b-b851-c24bda63579c None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:13.530490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd2bcc-dc20-459b-b851-c24bda63579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:13.574595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-f7fd2bcc-dc20-459b-b851-c24bda63579c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:13.576436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f7fd2bcc-dc20-459b-b851-c24bda63579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:13.589599 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1111/2198] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:13.593673 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad6755-e814-4247-9feb-2e4a165caeba None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:13.606869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad6755-e814-4247-9feb-2e4a165caeba None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:13.614119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7fd47-ddfc-4995-a4d6-26e51079d386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:13.615839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7fd47-ddfc-4995-a4d6-26e51079d386 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:13.616663 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7fd47-ddfc-4995-a4d6-26e51079d386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:13.617372 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7fd47-ddfc-4995-a4d6-26e51079d386 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:13.619095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7fd47-ddfc-4995-a4d6-26e51079d386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:38:13.619818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7fd47-ddfc-4995-a4d6-26e51079d386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:13.622398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7fd47-ddfc-4995-a4d6-26e51079d386 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:13.640670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1088/2199] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:38:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:38:13.645119 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd2bcc-dc20-459b-b851-c24bda63579c None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:13.659230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd2bcc-dc20-459b-b851-c24bda63579c None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:13.668246 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e808c6f-731f-443a-96fb-a161c19099b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:13.670051 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808c6f-731f-443a-96fb-a161c19099b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:13.670551 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808c6f-731f-443a-96fb-a161c19099b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:13.671063 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808c6f-731f-443a-96fb-a161c19099b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:13.672494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e808c6f-731f-443a-96fb-a161c19099b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:13.674839 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e808c6f-731f-443a-96fb-a161c19099b7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:13.710725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1112/2200] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:13 2021] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:38:13.712579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7fd47-ddfc-4995-a4d6-26e51079d386 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:13.732220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7fd47-ddfc-4995-a4d6-26e51079d386 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:13.740817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e808c6f-731f-443a-96fb-a161c19099b7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:13.754176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6e808c6f-731f-443a-96fb-a161c19099b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:13.851721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9c005-3f66-4c26-8c1d-8d8751175677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:13.853092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c005-3f66-4c26-8c1d-8d8751175677 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:13.853913 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c005-3f66-4c26-8c1d-8d8751175677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:13.854443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c005-3f66-4c26-8c1d-8d8751175677 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:13.855401 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9c005-3f66-4c26-8c1d-8d8751175677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:13.857536 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9c005-3f66-4c26-8c1d-8d8751175677 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:13.876319 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e808c6f-731f-443a-96fb-a161c19099b7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:13.882091 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:13.882956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:13.883227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:13.883690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] PATH_INFO: `/v3/projects/f6fe0d2a84684c76af0ea767b460f0ac` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:13.885007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6fe0d2a84684c76af0ea767b460f0ac)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:13.887505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1089/2201] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:13 2021] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:13.888045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:13.888976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9c005-3f66-4c26-8c1d-8d8751175677 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:13.891339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-46d9c005-3f66-4c26-8c1d-8d8751175677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:13.904845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9c005-3f66-4c26-8c1d-8d8751175677 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:13.910241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:13.911004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:13.911921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:13.911921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] PATH_INFO: `/v3/projects/3ae81ac49dbc413bbad34aa66c10913a` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:13.913046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae81ac49dbc413bbad34aa66c10913a)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:13.915578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:13.962216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6fe0d2a84684c76af0ea767b460f0ac', 'request_id': 'req-ac29c9cd-8874-4975-aac6-89a972e78ae8'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:13.969661 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6fe0d2a84684c76af0ea767b460f0ac', 'request_id': 'req-ac29c9cd-8874-4975-aac6-89a972e78ae8'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:13.978967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6fe0d2a84684c76af0ea767b460f0ac', 'request_id': 'req-ac29c9cd-8874-4975-aac6-89a972e78ae8'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:13.987736 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae81ac49dbc413bbad34aa66c10913a', 'request_id': 'req-70750de2-57a0-4915-828d-da369c5d6b25'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:13.990192 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] The token cache is being invalidate because project f6fe0d2a84684c76af0ea767b460f0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:13.991264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:13.992277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:13.994732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1113/2202] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:13 2021] DELETE /identity/v3/projects/f6fe0d2a84684c76af0ea767b460f0ac => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:38:13.995228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:13.996580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:13.996746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae81ac49dbc413bbad34aa66c10913a', 'request_id': 'req-70750de2-57a0-4915-828d-da369c5d6b25'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.010501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae81ac49dbc413bbad34aa66c10913a', 'request_id': 'req-70750de2-57a0-4915-828d-da369c5d6b25'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.029477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] The token cache is being invalidate because project 3ae81ac49dbc413bbad34aa66c10913a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:14.029477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.031880 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.031880 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1090/2203] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:13 2021] DELETE /identity/v3/projects/3ae81ac49dbc413bbad34aa66c10913a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:14.033179 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:14.036469 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:14.078182 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29c9cd-8874-4975-aac6-89a972e78ae8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:14.108307 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70750de2-57a0-4915-828d-da369c5d6b25 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:14.114395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:14.115291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:14.115540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:14.115818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] PATH_INFO: `/v3/users/87e6b849e9ef4a56b857ddfddd8633f8` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:14.117008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e6b849e9ef4a56b857ddfddd8633f8)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:14.119481 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:14.150272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa205db-aa4c-43aa-acb3-869df1bb2883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:14.150937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa205db-aa4c-43aa-acb3-869df1bb2883 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:14.151293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa205db-aa4c-43aa-acb3-869df1bb2883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:14.151590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa205db-aa4c-43aa-acb3-869df1bb2883 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:14.152487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa205db-aa4c-43aa-acb3-869df1bb2883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:14.154321 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa205db-aa4c-43aa-acb3-869df1bb2883 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:14.172010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1114/2204] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:13 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:14.173325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa205db-aa4c-43aa-acb3-869df1bb2883 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:14.175354 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1fa205db-aa4c-43aa-acb3-869df1bb2883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:14.187057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e6b849e9ef4a56b857ddfddd8633f8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.189954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa205db-aa4c-43aa-acb3-869df1bb2883 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:14.194351 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e6b849e9ef4a56b857ddfddd8633f8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.194664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:14.195526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:14.195805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:14.196121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] PATH_INFO: `/v3/users/96848864b18346b1b1743719b588aca9` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:14.197334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96848864b18346b1b1743719b588aca9)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:14.199645 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:14.204137 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e6b849e9ef4a56b857ddfddd8633f8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.220888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e6b849e9ef4a56b857ddfddd8633f8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.221620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e6b849e9ef4a56b857ddfddd8633f8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.229081 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1091/2205] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:14 2021] DELETE /identity/v3/users/87e6b849e9ef4a56b857ddfddd8633f8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:14.229980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:14.231576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:14.256749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96848864b18346b1b1743719b588aca9'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.266527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96848864b18346b1b1743719b588aca9'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.278425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96848864b18346b1b1743719b588aca9'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.292896 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96848864b18346b1b1743719b588aca9'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.293651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96848864b18346b1b1743719b588aca9'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:14.313416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1115/2206] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:14 2021] DELETE /identity/v3/users/96848864b18346b1b1743719b588aca9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:14.327694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011d253-ff38-446a-a334-86b7fe569c18 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:14.466677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53ce3c-5113-41f8-a238-63dce6c6ebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:14.467458 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ce3c-5113-41f8-a238-63dce6c6ebd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:14.467743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ce3c-5113-41f8-a238-63dce6c6ebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:14.468014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ce3c-5113-41f8-a238-63dce6c6ebd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:14.469052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53ce3c-5113-41f8-a238-63dce6c6ebd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:14.470801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53ce3c-5113-41f8-a238-63dce6c6ebd0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:14.483335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1092/2207] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:14.487357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:14.488872 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:14.503013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5355e52-b36d-4b6f-be6f-06d0925e3296 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:14.511363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a5e3c-b9cb-4923-bb45-91fb64186995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:14.512566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a5e3c-b9cb-4923-bb45-91fb64186995 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:14.513002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a5e3c-b9cb-4923-bb45-91fb64186995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:14.514093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a5e3c-b9cb-4923-bb45-91fb64186995 admin admin] PATH_INFO: `/v3/projects/b1bbd3d3e54b475fa9a25ecc80e4095b/users/f614a148d0ac47c481ac0547b349b674/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:14.537606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a5e3c-b9cb-4923-bb45-91fb64186995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1bbd3d3e54b475fa9a25ecc80e4095b, user_id=f614a148d0ac47c481ac0547b349b674, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:14.541522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a5e3c-b9cb-4923-bb45-91fb64186995 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:14.587954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1116/2208] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:14 2021] PUT /identity/v3/projects/b1bbd3d3e54b475fa9a25ecc80e4095b/users/f614a148d0ac47c481ac0547b349b674/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:38:14.603830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357423b6-7450-4b82-b699-6b8414f1c8e8 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:14.604372 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357423b6-7450-4b82-b699-6b8414f1c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:14.604669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357423b6-7450-4b82-b699-6b8414f1c8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:14.648600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-357423b6-7450-4b82-b699-6b8414f1c8e8 None None] MFA Rules not processed for user `f614a148d0ac47c481ac0547b349b674`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:14.650632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-357423b6-7450-4b82-b699-6b8414f1c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:14.764504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1093/2209] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:14 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:14.773098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a5e3c-b9cb-4923-bb45-91fb64186995 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:14.842693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357423b6-7450-4b82-b699-6b8414f1c8e8 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:14.844350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-357423b6-7450-4b82-b699-6b8414f1c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:14.893705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a5e3c-b9cb-4923-bb45-91fb64186995 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:14.900607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29efaa-e203-4b38-ad79-702e8eb4e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:14.901602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29efaa-e203-4b38-ad79-702e8eb4e3af admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:14.902100 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29efaa-e203-4b38-ad79-702e8eb4e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:14.902554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29efaa-e203-4b38-ad79-702e8eb4e3af admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:14.903437 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29efaa-e203-4b38-ad79-702e8eb4e3af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:14.907125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29efaa-e203-4b38-ad79-702e8eb4e3af admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:14.950149 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1117/2210] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:14 2021] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:38:14.954790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29efaa-e203-4b38-ad79-702e8eb4e3af admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:14.958306 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357423b6-7450-4b82-b699-6b8414f1c8e8 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.039116 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.040237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.040642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.041016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] PATH_INFO: `/v3/projects/bd49926f446b4a1682867118bb1bc532` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.042510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd49926f446b4a1682867118bb1bc532)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.044368 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.046267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29efaa-e203-4b38-ad79-702e8eb4e3af admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.053186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c706393-48ae-4c65-865e-990f111dc9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.053987 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c706393-48ae-4c65-865e-990f111dc9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.054332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c706393-48ae-4c65-865e-990f111dc9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.054672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c706393-48ae-4c65-865e-990f111dc9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.055972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c706393-48ae-4c65-865e-990f111dc9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.057967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c706393-48ae-4c65-865e-990f111dc9d5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.083818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1118/2211] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:14 2021] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:15.084959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c706393-48ae-4c65-865e-990f111dc9d5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.087334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2c706393-48ae-4c65-865e-990f111dc9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:15.099843 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c706393-48ae-4c65-865e-990f111dc9d5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.102140 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd49926f446b4a1682867118bb1bc532', 'request_id': 'req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:15.108429 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd49926f446b4a1682867118bb1bc532', 'request_id': 'req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:15.117022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd49926f446b4a1682867118bb1bc532', 'request_id': 'req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:15.132131 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] The token cache is being invalidate because project bd49926f446b4a1682867118bb1bc532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:15.132638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:15.133390 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:15.135761 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1094/2212] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:14 2021] DELETE /identity/v3/projects/bd49926f446b4a1682867118bb1bc532 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:15.139911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.140924 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:15.168938 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.170312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.170971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.171494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] PATH_INFO: `/v3/projects/3f8d188272aa4bdea7244bc5c37a1cfa` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.173179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8d188272aa4bdea7244bc5c37a1cfa)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.175755 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.229825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f61b8-a1fa-4957-a1ad-fcded7dfcd91 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.239115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8d188272aa4bdea7244bc5c37a1cfa', 'request_id': 'req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:15.246388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8d188272aa4bdea7244bc5c37a1cfa', 'request_id': 'req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:15.255577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8d188272aa4bdea7244bc5c37a1cfa', 'request_id': 'req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:15.277029 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] The token cache is being invalidate because project 3f8d188272aa4bdea7244bc5c37a1cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:15.277322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:15.278035 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-035461a3-6824-4b30-8a8a-1bad6e4a7cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:15.285244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1119/2213] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:15 2021] DELETE /identity/v3/projects/3f8d188272aa4bdea7244bc5c37a1cfa => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:15.285244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600468c9-f1cc-4656-a4d6-a9cb399ef125 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.285244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600468c9-f1cc-4656-a4d6-a9cb399ef125 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.285244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600468c9-f1cc-4656-a4d6-a9cb399ef125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.304781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-600468c9-f1cc-4656-a4d6-a9cb399ef125 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:15.306801 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-600468c9-f1cc-4656-a4d6-a9cb399ef125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:15.313082 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3c6da-4fd0-4333-8149-b36faa6bb192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.315602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3c6da-4fd0-4333-8149-b36faa6bb192 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.315895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3c6da-4fd0-4333-8149-b36faa6bb192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.316240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3c6da-4fd0-4333-8149-b36faa6bb192 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.317161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3c6da-4fd0-4333-8149-b36faa6bb192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.319391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3c6da-4fd0-4333-8149-b36faa6bb192 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.325408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1120/2214] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:15.327992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e622f-4046-4f57-80dd-94a2c59ae1cf None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.328604 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e622f-4046-4f57-80dd-94a2c59ae1cf None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.329061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e622f-4046-4f57-80dd-94a2c59ae1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.333101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1095/2215] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:15.334686 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2413fc5-efc0-4e77-a697-725d4733c578 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.335230 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2413fc5-efc0-4e77-a697-725d4733c578 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.335545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2413fc5-efc0-4e77-a697-725d4733c578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.358666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d41e622f-4046-4f57-80dd-94a2c59ae1cf None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:15.360120 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d41e622f-4046-4f57-80dd-94a2c59ae1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:15.366115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b2413fc5-efc0-4e77-a697-725d4733c578 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:15.367431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b2413fc5-efc0-4e77-a697-725d4733c578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:15.373818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1121/2216] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:15.373818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e622f-4046-4f57-80dd-94a2c59ae1cf None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.373818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d41e622f-4046-4f57-80dd-94a2c59ae1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:15.385082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e622f-4046-4f57-80dd-94a2c59ae1cf None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.386162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1096/2217] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:15.389554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d597e20-da7e-4ee9-8fe4-2d1074448b4e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.389554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d597e20-da7e-4ee9-8fe4-2d1074448b4e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.389554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d597e20-da7e-4ee9-8fe4-2d1074448b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.395759 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f0829-a3ec-45e0-a74d-0b39844d55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.396665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f0829-a3ec-45e0-a74d-0b39844d55e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.396943 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f0829-a3ec-45e0-a74d-0b39844d55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.397216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f0829-a3ec-45e0-a74d-0b39844d55e2 admin admin] PATH_INFO: `/v3/projects/f1aacb519b0649138b2c02980de265b9/users/2351db57278e4933b183d26e27e4b1ea/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.418431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-4d597e20-da7e-4ee9-8fe4-2d1074448b4e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:15.419782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4d597e20-da7e-4ee9-8fe4-2d1074448b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:15.424381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f0829-a3ec-45e0-a74d-0b39844d55e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1aacb519b0649138b2c02980de265b9, user_id=2351db57278e4933b183d26e27e4b1ea, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.427559 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f0829-a3ec-45e0-a74d-0b39844d55e2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.434421 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1097/2218] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:15.434421 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d597e20-da7e-4ee9-8fe4-2d1074448b4e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.445617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d597e20-da7e-4ee9-8fe4-2d1074448b4e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.449193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1122/2219] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:15 2021] PUT /identity/v3/projects/f1aacb519b0649138b2c02980de265b9/users/2351db57278e4933b183d26e27e4b1ea/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:15.450081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f0829-a3ec-45e0-a74d-0b39844d55e2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.520708 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe681-e5b3-43a1-8f96-1958da227dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.521559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe681-e5b3-43a1-8f96-1958da227dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.521869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe681-e5b3-43a1-8f96-1958da227dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.522144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe681-e5b3-43a1-8f96-1958da227dc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.523336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fe681-e5b3-43a1-8f96-1958da227dc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:38:15.523645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fe681-e5b3-43a1-8f96-1958da227dc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.525848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fe681-e5b3-43a1-8f96-1958da227dc6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.544640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1098/2220] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:38:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:38:15.545671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe681-e5b3-43a1-8f96-1958da227dc6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.551798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f0829-a3ec-45e0-a74d-0b39844d55e2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.558874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe681-e5b3-43a1-8f96-1958da227dc6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.572912 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e28b15-8944-4aa8-b1f3-4e0250eb3b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.573724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e28b15-8944-4aa8-b1f3-4e0250eb3b17 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.574117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e28b15-8944-4aa8-b1f3-4e0250eb3b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.574486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e28b15-8944-4aa8-b1f3-4e0250eb3b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.575300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e28b15-8944-4aa8-b1f3-4e0250eb3b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.577226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e28b15-8944-4aa8-b1f3-4e0250eb3b17 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.579570 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd45f8-3717-48ba-8762-0d47b9683beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.580237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd45f8-3717-48ba-8762-0d47b9683beb admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.580519 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd45f8-3717-48ba-8762-0d47b9683beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.580793 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd45f8-3717-48ba-8762-0d47b9683beb admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.581693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd45f8-3717-48ba-8762-0d47b9683beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:38:15.582056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd45f8-3717-48ba-8762-0d47b9683beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.583674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd45f8-3717-48ba-8762-0d47b9683beb admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.591417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1099/2221] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:15.592895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e28b15-8944-4aa8-b1f3-4e0250eb3b17 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.601834 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1123/2222] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:38:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:38:15.603667 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd45f8-3717-48ba-8762-0d47b9683beb admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.611251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e28b15-8944-4aa8-b1f3-4e0250eb3b17 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.614932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd45f8-3717-48ba-8762-0d47b9683beb admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.617447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002156b-0fb9-49fb-a451-766bb4184c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.618409 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002156b-0fb9-49fb-a451-766bb4184c3e admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.618769 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002156b-0fb9-49fb-a451-766bb4184c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.619192 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002156b-0fb9-49fb-a451-766bb4184c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.620728 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002156b-0fb9-49fb-a451-766bb4184c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.621186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9838b5-583c-4bce-98f0-2dcc90cedfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.622320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9838b5-583c-4bce-98f0-2dcc90cedfa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.622786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9838b5-583c-4bce-98f0-2dcc90cedfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.623196 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002156b-0fb9-49fb-a451-766bb4184c3e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.623418 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9838b5-583c-4bce-98f0-2dcc90cedfa6 admin admin] PATH_INFO: `/v3/projects/f1aacb519b0649138b2c02980de265b9/users/2351db57278e4933b183d26e27e4b1ea/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.639064 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9838b5-583c-4bce-98f0-2dcc90cedfa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1aacb519b0649138b2c02980de265b9, user_id=2351db57278e4933b183d26e27e4b1ea, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.652858 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9838b5-583c-4bce-98f0-2dcc90cedfa6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.667287 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1100/2223] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:15 2021] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:15.668671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002156b-0fb9-49fb-a451-766bb4184c3e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.671066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1124/2224] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:15 2021] PUT /identity/v3/projects/f1aacb519b0649138b2c02980de265b9/users/2351db57278e4933b183d26e27e4b1ea/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:15.671910 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9838b5-583c-4bce-98f0-2dcc90cedfa6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.748491 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9838b5-583c-4bce-98f0-2dcc90cedfa6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.769188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002156b-0fb9-49fb-a451-766bb4184c3e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.777090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6ed67-e82b-4bdc-9989-f1369f3ae180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.778073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ed67-e82b-4bdc-9989-f1369f3ae180 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.778515 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ed67-e82b-4bdc-9989-f1369f3ae180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.779504 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ed67-e82b-4bdc-9989-f1369f3ae180 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.780326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ed67-e82b-4bdc-9989-f1369f3ae180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.782116 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ed67-e82b-4bdc-9989-f1369f3ae180 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.816360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1101/2225] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:15 2021] POST /identity/v3/projects => generated 361 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:15.818052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5390cd6-8a79-4995-a3be-94c4012ea22d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.818346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5390cd6-8a79-4995-a3be-94c4012ea22d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.818626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5390cd6-8a79-4995-a3be-94c4012ea22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.831314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282d98-b5bc-483e-9dc0-1fea1f28ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.832118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282d98-b5bc-483e-9dc0-1fea1f28ca75 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.832623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282d98-b5bc-483e-9dc0-1fea1f28ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.832905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282d98-b5bc-483e-9dc0-1fea1f28ca75 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.833612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53282d98-b5bc-483e-9dc0-1fea1f28ca75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.835557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53282d98-b5bc-483e-9dc0-1fea1f28ca75 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.855140 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-a5390cd6-8a79-4995-a3be-94c4012ea22d None None] MFA Rules not processed for user `2351db57278e4933b183d26e27e4b1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:15.857089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a5390cd6-8a79-4995-a3be-94c4012ea22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:15.862933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1125/2226] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:15 2021] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:15.863814 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282d98-b5bc-483e-9dc0-1fea1f28ca75 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.873436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282d98-b5bc-483e-9dc0-1fea1f28ca75 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.933708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577093-0232-412c-be82-c2476894fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.934566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577093-0232-412c-be82-c2476894fe07 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.935249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577093-0232-412c-be82-c2476894fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.935249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577093-0232-412c-be82-c2476894fe07 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.936269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50577093-0232-412c-be82-c2476894fe07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.938249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50577093-0232-412c-be82-c2476894fe07 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.954829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1102/2227] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:15 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:15.955689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5390cd6-8a79-4995-a3be-94c4012ea22d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.967828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1126/2228] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:15 2021] POST /identity/v3/users => generated 281 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:15.968633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577093-0232-412c-be82-c2476894fe07 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:15.970606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-50577093-0232-412c-be82-c2476894fe07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:15.972975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5390cd6-8a79-4995-a3be-94c4012ea22d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:15.978427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d4a01-71e6-423d-ad94-6421b0bd2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:15.979417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d4a01-71e6-423d-ad94-6421b0bd2b08 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:15.979417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d4a01-71e6-423d-ad94-6421b0bd2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:15.979650 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d4a01-71e6-423d-ad94-6421b0bd2b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:15.980424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d4a01-71e6-423d-ad94-6421b0bd2b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:15.982109 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d4a01-71e6-423d-ad94-6421b0bd2b08 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:15.992787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1103/2229] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:15.993587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d4a01-71e6-423d-ad94-6421b0bd2b08 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.004735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d4a01-71e6-423d-ad94-6421b0bd2b08 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.010185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cd918-673f-43b0-a257-411a6e3bee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.010885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cd918-673f-43b0-a257-411a6e3bee9f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.011172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cd918-673f-43b0-a257-411a6e3bee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.011443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cd918-673f-43b0-a257-411a6e3bee9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.012185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cd918-673f-43b0-a257-411a6e3bee9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.013867 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cd918-673f-43b0-a257-411a6e3bee9f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.024051 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1104/2230] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:16.027762 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cd918-673f-43b0-a257-411a6e3bee9f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.043859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cd918-673f-43b0-a257-411a6e3bee9f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.050341 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577093-0232-412c-be82-c2476894fe07 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.053888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcdcca-c91a-4e35-9a45-eaef9eac3532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.054566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcdcca-c91a-4e35-9a45-eaef9eac3532 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.054852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcdcca-c91a-4e35-9a45-eaef9eac3532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.055125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcdcca-c91a-4e35-9a45-eaef9eac3532 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.055899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcdcca-c91a-4e35-9a45-eaef9eac3532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.056028 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad7ab2-0bcd-48f6-8144-e3e9815d365b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.056638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad7ab2-0bcd-48f6-8144-e3e9815d365b service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.056921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad7ab2-0bcd-48f6-8144-e3e9815d365b service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.057196 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad7ab2-0bcd-48f6-8144-e3e9815d365b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.058031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcdcca-c91a-4e35-9a45-eaef9eac3532 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.072453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad7ab2-0bcd-48f6-8144-e3e9815d365b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.074131 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad7ab2-0bcd-48f6-8144-e3e9815d365b service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.082054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1105/2231] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:16 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:16.082862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcdcca-c91a-4e35-9a45-eaef9eac3532 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.089297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1127/2232] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:15 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:16.090269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad7ab2-0bcd-48f6-8144-e3e9815d365b service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.107064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcdcca-c91a-4e35-9a45-eaef9eac3532 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.108680 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad7ab2-0bcd-48f6-8144-e3e9815d365b service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.112529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cf3fe-0772-4ed8-8d59-288220fe0da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.113193 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cf3fe-0772-4ed8-8d59-288220fe0da7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.113477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cf3fe-0772-4ed8-8d59-288220fe0da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.113767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cf3fe-0772-4ed8-8d59-288220fe0da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.113871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a0283-5c6f-4ce6-b133-6122c93b65cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.114820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cf3fe-0772-4ed8-8d59-288220fe0da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.115079 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a0283-5c6f-4ce6-b133-6122c93b65cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.115435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a0283-5c6f-4ce6-b133-6122c93b65cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.115782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a0283-5c6f-4ce6-b133-6122c93b65cb admin admin] PATH_INFO: `/v3/projects/32a1029fc4db4ca79968815087f0af5c/users/7bd6fb5c7de34c28a3569f587da8a947/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.117682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cf3fe-0772-4ed8-8d59-288220fe0da7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.131647 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1106/2233] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:16 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:16.137281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cf3fe-0772-4ed8-8d59-288220fe0da7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.142005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a0283-5c6f-4ce6-b133-6122c93b65cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a1029fc4db4ca79968815087f0af5c, user_id=7bd6fb5c7de34c28a3569f587da8a947, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.148593 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a0283-5c6f-4ce6-b133-6122c93b65cb admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.155039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cf3fe-0772-4ed8-8d59-288220fe0da7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.160249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d0411-c839-47cb-9079-b83754f3c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.161216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d0411-c839-47cb-9079-b83754f3c251 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.161782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d0411-c839-47cb-9079-b83754f3c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.162090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d0411-c839-47cb-9079-b83754f3c251 admin admin] PATH_INFO: `/v3/projects/c1e8ec2de72d4ff194abcb4327a6db10/users/081d9f6d1c154165840be477bfce88b2/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.175895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1128/2234] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:16 2021] PUT /identity/v3/projects/32a1029fc4db4ca79968815087f0af5c/users/7bd6fb5c7de34c28a3569f587da8a947/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:16.189302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd601b01-4ede-4e78-ae0c-34063b2c1340 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.189708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd601b01-4ede-4e78-ae0c-34063b2c1340 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.190083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd601b01-4ede-4e78-ae0c-34063b2c1340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.199936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d0411-c839-47cb-9079-b83754f3c251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e8ec2de72d4ff194abcb4327a6db10, user_id=081d9f6d1c154165840be477bfce88b2, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.205914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d0411-c839-47cb-9079-b83754f3c251 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.238519 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-fd601b01-4ede-4e78-ae0c-34063b2c1340 None None] MFA Rules not processed for user `7bd6fb5c7de34c28a3569f587da8a947`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:16.240027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-fd601b01-4ede-4e78-ae0c-34063b2c1340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:16.244182 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1107/2235] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:16 2021] PUT /identity/v3/projects/c1e8ec2de72d4ff194abcb4327a6db10/users/081d9f6d1c154165840be477bfce88b2/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:16.264340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860a3f-dc53-4a58-83da-980558f4a24c None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.264793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860a3f-dc53-4a58-83da-980558f4a24c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.265078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860a3f-dc53-4a58-83da-980558f4a24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.309524 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-ae860a3f-dc53-4a58-83da-980558f4a24c None None] MFA Rules not processed for user `081d9f6d1c154165840be477bfce88b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:16.311231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ae860a3f-dc53-4a58-83da-980558f4a24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:16.338928 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1129/2236] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:16 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:16.340204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd601b01-4ede-4e78-ae0c-34063b2c1340 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.403633 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1108/2237] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:16 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:16.439997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae860a3f-dc53-4a58-83da-980558f4a24c None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.459917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd601b01-4ede-4e78-ae0c-34063b2c1340 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.476673 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0a610-0aba-41cf-bf05-635eceb7d7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.477669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a610-0aba-41cf-bf05-635eceb7d7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.478069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a610-0aba-41cf-bf05-635eceb7d7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.478512 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a610-0aba-41cf-bf05-635eceb7d7d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.479559 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0a610-0aba-41cf-bf05-635eceb7d7d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.482254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0a610-0aba-41cf-bf05-635eceb7d7d0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.533442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae860a3f-dc53-4a58-83da-980558f4a24c None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.535603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1130/2238] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:16 2021] POST /identity/v3/projects => generated 369 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:16.541591 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0a610-0aba-41cf-bf05-635eceb7d7d0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.634488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27545a8-ed5b-4d11-a892-56194e30f804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.635045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27545a8-ed5b-4d11-a892-56194e30f804 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.635334 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27545a8-ed5b-4d11-a892-56194e30f804 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.635615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27545a8-ed5b-4d11-a892-56194e30f804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.658122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0a610-0aba-41cf-bf05-635eceb7d7d0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.671811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7103f-f3fe-4396-bfa3-20fea478e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.672571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7103f-f3fe-4396-bfa3-20fea478e0fe admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.672860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7103f-f3fe-4396-bfa3-20fea478e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.673139 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7103f-f3fe-4396-bfa3-20fea478e0fe admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.673915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7103f-f3fe-4396-bfa3-20fea478e0fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.675914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7103f-f3fe-4396-bfa3-20fea478e0fe admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.714853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27545a8-ed5b-4d11-a892-56194e30f804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.716410 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27545a8-ed5b-4d11-a892-56194e30f804 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.718821 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1131/2239] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:16 2021] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:38:16.720186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7103f-f3fe-4396-bfa3-20fea478e0fe admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.728363 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1109/2240] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:16 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:16.729526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27545a8-ed5b-4d11-a892-56194e30f804 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.735039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7103f-f3fe-4396-bfa3-20fea478e0fe admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.744076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27545a8-ed5b-4d11-a892-56194e30f804 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.751160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d7762-fb85-49be-8093-fbf7e66a4ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.752490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d7762-fb85-49be-8093-fbf7e66a4ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.752490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d7762-fb85-49be-8093-fbf7e66a4ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.752490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d7762-fb85-49be-8093-fbf7e66a4ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.753591 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d7762-fb85-49be-8093-fbf7e66a4ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.755306 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d7762-fb85-49be-8093-fbf7e66a4ee9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.756360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.757823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.758242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.759150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] PATH_INFO: `/v3/users/f614a148d0ac47c481ac0547b349b674` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.764300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f614a148d0ac47c481ac0547b349b674)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.765722 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.771859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1110/2241] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:16 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:16.773166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d7762-fb85-49be-8093-fbf7e66a4ee9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.791985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d7762-fb85-49be-8093-fbf7e66a4ee9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:16.799318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c7ea3-7803-4dfe-97f7-33a8b8839a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:16.800623 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c7ea3-7803-4dfe-97f7-33a8b8839a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:16.801067 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c7ea3-7803-4dfe-97f7-33a8b8839a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:16.801860 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c7ea3-7803-4dfe-97f7-33a8b8839a53 admin admin] PATH_INFO: `/v3/users/081d9f6d1c154165840be477bfce88b2` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:16.804027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c7ea3-7803-4dfe-97f7-33a8b8839a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=081d9f6d1c154165840be477bfce88b2)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:16.815250 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c7ea3-7803-4dfe-97f7-33a8b8839a53 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:16.871227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f614a148d0ac47c481ac0547b349b674'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:16.878848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f614a148d0ac47c481ac0547b349b674'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:16.879792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f614a148d0ac47c481ac0547b349b674'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:16.901424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f614a148d0ac47c481ac0547b349b674'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:16.902517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f614a148d0ac47c481ac0547b349b674'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:16.943952 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a02c7ea3-7803-4dfe-97f7-33a8b8839a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081d9f6d1c154165840be477bfce88b2'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:16.952095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1132/2242] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:16 2021] DELETE /identity/v3/users/f614a148d0ac47c481ac0547b349b674 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:16.955094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:16.963316 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:16.964560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a02c7ea3-7803-4dfe-97f7-33a8b8839a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081d9f6d1c154165840be477bfce88b2'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:16.978377 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a02c7ea3-7803-4dfe-97f7-33a8b8839a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081d9f6d1c154165840be477bfce88b2'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:17.013470 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a02c7ea3-7803-4dfe-97f7-33a8b8839a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081d9f6d1c154165840be477bfce88b2'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:17.014471 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a02c7ea3-7803-4dfe-97f7-33a8b8839a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081d9f6d1c154165840be477bfce88b2'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:17.036536 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1111/2243] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:16 2021] DELETE /identity/v3/users/081d9f6d1c154165840be477bfce88b2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:17.038862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778a26-23d3-4040-8d1b-6a76352d3243 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:17.039330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778a26-23d3-4040-8d1b-6a76352d3243 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:17.040347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778a26-23d3-4040-8d1b-6a76352d3243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:17.073060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-75778a26-23d3-4040-8d1b-6a76352d3243 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:17.073300 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1298b1-15b1-46d8-bd30-fa6b3c00001d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:17.075156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-75778a26-23d3-4040-8d1b-6a76352d3243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:17.190669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317f380-6159-4d65-aced-60c3970371e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:17.190669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f380-6159-4d65-aced-60c3970371e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:17.190669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f380-6159-4d65-aced-60c3970371e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:17.190669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f380-6159-4d65-aced-60c3970371e5 admin admin] PATH_INFO: `/v3/projects/3f1c259827da4c61bffa242e53397930/users/8f0d3b1592ed4298b8abc219cb7573d5/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:17.199733 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1112/2244] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:17.199733 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a833df9-1189-413d-9ab6-0a0bc74f6a9d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:17.206027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a833df9-1189-413d-9ab6-0a0bc74f6a9d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:17.207136 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a833df9-1189-413d-9ab6-0a0bc74f6a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:17.236764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317f380-6159-4d65-aced-60c3970371e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1c259827da4c61bffa242e53397930, user_id=8f0d3b1592ed4298b8abc219cb7573d5, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:17.240137 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-1a833df9-1189-413d-9ab6-0a0bc74f6a9d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:17.240546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317f380-6159-4d65-aced-60c3970371e5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:17.242471 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1a833df9-1189-413d-9ab6-0a0bc74f6a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:17.256607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1113/2245] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:17.257847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a833df9-1189-413d-9ab6-0a0bc74f6a9d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:17.260323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1a833df9-1189-413d-9ab6-0a0bc74f6a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:17.268122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1133/2246] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:16 2021] PUT /identity/v3/projects/3f1c259827da4c61bffa242e53397930/users/8f0d3b1592ed4298b8abc219cb7573d5/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:17.270005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317f380-6159-4d65-aced-60c3970371e5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:17.273486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6317f380-6159-4d65-aced-60c3970371e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:17.385380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317f380-6159-4d65-aced-60c3970371e5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:17.391276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6382f4-39de-4eda-9d7e-7e0d1912e2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:17.391802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6382f4-39de-4eda-9d7e-7e0d1912e2dd admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:17.392088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6382f4-39de-4eda-9d7e-7e0d1912e2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:17.392365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6382f4-39de-4eda-9d7e-7e0d1912e2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:17.393274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6382f4-39de-4eda-9d7e-7e0d1912e2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:17.394914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6382f4-39de-4eda-9d7e-7e0d1912e2dd admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:17.409886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1134/2247] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:17 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:38:17.409886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6382f4-39de-4eda-9d7e-7e0d1912e2dd admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:17.411654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-dc6382f4-39de-4eda-9d7e-7e0d1912e2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:17.426877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a833df9-1189-413d-9ab6-0a0bc74f6a9d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:17.485950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a6d87-3164-49a0-9146-4175d2a022e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:17.486991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a6d87-3164-49a0-9146-4175d2a022e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:17.487531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a6d87-3164-49a0-9146-4175d2a022e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:17.487939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a6d87-3164-49a0-9146-4175d2a022e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:17.489612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6382f4-39de-4eda-9d7e-7e0d1912e2dd admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:17.495487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77d55a-a842-49dd-b280-ec889df7b97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:17.496593 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d55a-a842-49dd-b280-ec889df7b97a service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:17.497132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d55a-a842-49dd-b280-ec889df7b97a service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:17.497658 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d55a-a842-49dd-b280-ec889df7b97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:17.503710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a6d87-3164-49a0-9146-4175d2a022e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:17.505373 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a6d87-3164-49a0-9146-4175d2a022e9 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:17.514602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77d55a-a842-49dd-b280-ec889df7b97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:17.516075 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1114/2248] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:17.516884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a6d87-3164-49a0-9146-4175d2a022e9 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:17.517687 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77d55a-a842-49dd-b280-ec889df7b97a service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:17.526836 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a6d87-3164-49a0-9146-4175d2a022e9 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:17.532241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b5141-509c-49e3-b078-138de986d935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:17.533815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b5141-509c-49e3-b078-138de986d935 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:17.534424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b5141-509c-49e3-b078-138de986d935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:17.534424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b5141-509c-49e3-b078-138de986d935 admin admin] PATH_INFO: `/v3/projects/3f1c259827da4c61bffa242e53397930/users/8f0d3b1592ed4298b8abc219cb7573d5/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:17.536752 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b5141-509c-49e3-b078-138de986d935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1c259827da4c61bffa242e53397930, user_id=8f0d3b1592ed4298b8abc219cb7573d5, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:17.539517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1135/2249] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:17.539988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b5141-509c-49e3-b078-138de986d935 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:17.551850 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1115/2250] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:17 2021] PUT /identity/v3/projects/3f1c259827da4c61bffa242e53397930/users/8f0d3b1592ed4298b8abc219cb7573d5/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:17.569299 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd4c42-5f25-49d5-8f32-f60fe314de3d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:17.570145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd4c42-5f25-49d5-8f32-f60fe314de3d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:17.570923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd4c42-5f25-49d5-8f32-f60fe314de3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:17.627476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-0ffd4c42-5f25-49d5-8f32-f60fe314de3d None None] MFA Rules not processed for user `8f0d3b1592ed4298b8abc219cb7573d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:17.629297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0ffd4c42-5f25-49d5-8f32-f60fe314de3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:17.797058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1136/2251] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:17 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:17.805871 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b5141-509c-49e3-b078-138de986d935 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:17.809560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f49b5141-509c-49e3-b078-138de986d935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:17.882255 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b5141-509c-49e3-b078-138de986d935 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:17.891006 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41e6d4-1ffc-4762-9b2e-9f13140003b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:17.892114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41e6d4-1ffc-4762-9b2e-9f13140003b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:17.892604 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41e6d4-1ffc-4762-9b2e-9f13140003b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:17.893090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41e6d4-1ffc-4762-9b2e-9f13140003b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:17.918626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41e6d4-1ffc-4762-9b2e-9f13140003b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:17.920424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41e6d4-1ffc-4762-9b2e-9f13140003b4 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:17.932136 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1116/2252] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:17 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:38:18.000334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd4c42-5f25-49d5-8f32-f60fe314de3d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:18.003208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0ffd4c42-5f25-49d5-8f32-f60fe314de3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:18.018849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd4c42-5f25-49d5-8f32-f60fe314de3d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:18.023312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073a5b9-bd8b-4333-9afe-663192cd1671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:18.024139 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073a5b9-bd8b-4333-9afe-663192cd1671 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:18.024613 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073a5b9-bd8b-4333-9afe-663192cd1671 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:18.025271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073a5b9-bd8b-4333-9afe-663192cd1671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:18.027556 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a073a5b9-bd8b-4333-9afe-663192cd1671 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:18.102174 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41e6d4-1ffc-4762-9b2e-9f13140003b4 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:18.104114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8f41e6d4-1ffc-4762-9b2e-9f13140003b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:18.128681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073a5b9-bd8b-4333-9afe-663192cd1671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:18.130249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073a5b9-bd8b-4333-9afe-663192cd1671 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:18.177641 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1137/2253] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:17 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:18.180255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073a5b9-bd8b-4333-9afe-663192cd1671 service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:18.184294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a073a5b9-bd8b-4333-9afe-663192cd1671 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:18.278627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41e6d4-1ffc-4762-9b2e-9f13140003b4 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:18.288768 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073a5b9-bd8b-4333-9afe-663192cd1671 service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:18.292777 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:18.293648 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:18.293954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:18.294228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] PATH_INFO: `/v3/projects/b1bbd3d3e54b475fa9a25ecc80e4095b` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:18.295612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:18.296621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:18.296909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:18.297191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] PATH_INFO: `/v3/projects/c1e8ec2de72d4ff194abcb4327a6db10` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:18.298443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1bbd3d3e54b475fa9a25ecc80e4095b)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:18.298739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e8ec2de72d4ff194abcb4327a6db10)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:18.300374 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:18.301322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:18.391529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1bbd3d3e54b475fa9a25ecc80e4095b', 'request_id': 'req-f83906b0-06b2-4584-bd3a-8924e7187e0f'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.399778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1bbd3d3e54b475fa9a25ecc80e4095b', 'request_id': 'req-f83906b0-06b2-4584-bd3a-8924e7187e0f'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.401522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e8ec2de72d4ff194abcb4327a6db10', 'request_id': 'req-4b3edff2-e8b8-478d-859c-e47c9c2c690e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.409403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e8ec2de72d4ff194abcb4327a6db10', 'request_id': 'req-4b3edff2-e8b8-478d-859c-e47c9c2c690e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.419323 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1bbd3d3e54b475fa9a25ecc80e4095b', 'request_id': 'req-f83906b0-06b2-4584-bd3a-8924e7187e0f'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.424708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e8ec2de72d4ff194abcb4327a6db10', 'request_id': 'req-4b3edff2-e8b8-478d-859c-e47c9c2c690e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.437678 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] The token cache is being invalidate because project b1bbd3d3e54b475fa9a25ecc80e4095b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:18.438013 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.439118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.440898 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1117/2254] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:18 2021] DELETE /identity/v3/projects/b1bbd3d3e54b475fa9a25ecc80e4095b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:38:18.443724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] The token cache is being invalidate because project c1e8ec2de72d4ff194abcb4327a6db10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:18.443724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.444104 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4b3edff2-e8b8-478d-859c-e47c9c2c690e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.445008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:18.446688 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:18.447178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1138/2255] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:18 2021] DELETE /identity/v3/projects/c1e8ec2de72d4ff194abcb4327a6db10 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:18.452992 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e2e4b-1ad2-4b0f-a0e9-2ed90a1b1045 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:18.453290 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e2e4b-1ad2-4b0f-a0e9-2ed90a1b1045 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:18.453571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e2e4b-1ad2-4b0f-a0e9-2ed90a1b1045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:18.487642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-836e2e4b-1ad2-4b0f-a0e9-2ed90a1b1045 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:18.490529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-836e2e4b-1ad2-4b0f-a0e9-2ed90a1b1045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:18.544354 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83906b0-06b2-4584-bd3a-8924e7187e0f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:18.588417 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1139/2256] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:18.590429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053c0ee-82fa-4f13-aa8d-d0540a70a080 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:18.590726 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053c0ee-82fa-4f13-aa8d-d0540a70a080 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:18.591005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053c0ee-82fa-4f13-aa8d-d0540a70a080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:18.635416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a053c0ee-82fa-4f13-aa8d-d0540a70a080 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:18.636742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a053c0ee-82fa-4f13-aa8d-d0540a70a080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:18.649880 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1140/2257] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:38:18.657686 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053c0ee-82fa-4f13-aa8d-d0540a70a080 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:18.668254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:18.672485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053c0ee-82fa-4f13-aa8d-d0540a70a080 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:18.680033 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2d72c-d0b5-4ac0-8e39-cada6bcfa40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:18.680211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:18.680573 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:18.680926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] PATH_INFO: `/v3/users/2351db57278e4933b183d26e27e4b1ea` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:18.681036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2d72c-d0b5-4ac0-8e39-cada6bcfa40b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:18.681393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2d72c-d0b5-4ac0-8e39-cada6bcfa40b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:18.681823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2d72c-d0b5-4ac0-8e39-cada6bcfa40b admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:18.692819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2d72c-d0b5-4ac0-8e39-cada6bcfa40b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:38:18.692819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2d72c-d0b5-4ac0-8e39-cada6bcfa40b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:18.693163 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2351db57278e4933b183d26e27e4b1ea)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:18.693253 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2d72c-d0b5-4ac0-8e39-cada6bcfa40b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:18.693342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:18.700797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1141/2258] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:38:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:38:18.702240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2d72c-d0b5-4ac0-8e39-cada6bcfa40b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:18.712703 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2d72c-d0b5-4ac0-8e39-cada6bcfa40b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:18.717293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364f917-8a23-4269-80e9-0d35ea63a42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:18.718619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364f917-8a23-4269-80e9-0d35ea63a42c admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:18.718907 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364f917-8a23-4269-80e9-0d35ea63a42c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:18.719183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364f917-8a23-4269-80e9-0d35ea63a42c admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:18.719875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364f917-8a23-4269-80e9-0d35ea63a42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:18.721781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364f917-8a23-4269-80e9-0d35ea63a42c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:18.747177 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2351db57278e4933b183d26e27e4b1ea'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.749502 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1142/2259] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:18 2021] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:18.753709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364f917-8a23-4269-80e9-0d35ea63a42c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:18.755133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2351db57278e4933b183d26e27e4b1ea'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.763145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2351db57278e4933b183d26e27e4b1ea'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.780322 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2351db57278e4933b183d26e27e4b1ea'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.781026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2351db57278e4933b183d26e27e4b1ea'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:18.787091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1118/2260] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:18 2021] DELETE /identity/v3/users/2351db57278e4933b183d26e27e4b1ea => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:18.822387 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364f917-8a23-4269-80e9-0d35ea63a42c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:18.889288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761305-9603-405c-8911-9ec72cdb8ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:18.890083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761305-9603-405c-8911-9ec72cdb8ffb admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:18.890436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761305-9603-405c-8911-9ec72cdb8ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:18.890788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761305-9603-405c-8911-9ec72cdb8ffb admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:18.891565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50761305-9603-405c-8911-9ec72cdb8ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:18.893523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50761305-9603-405c-8911-9ec72cdb8ffb admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:18.919265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:18.920743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:18.921892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1143/2261] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:18 2021] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:18.944959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890bb61-efdc-48a5-b956-a7110135c603 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:18.950942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ca4f4-48f6-419c-9c17-16b86212ec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:18.951887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca4f4-48f6-419c-9c17-16b86212ec4a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:18.952165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca4f4-48f6-419c-9c17-16b86212ec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:18.952438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca4f4-48f6-419c-9c17-16b86212ec4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:18.953172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ca4f4-48f6-419c-9c17-16b86212ec4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:18.954848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ca4f4-48f6-419c-9c17-16b86212ec4a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:18.971220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1119/2262] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:18 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:18.972577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761305-9603-405c-8911-9ec72cdb8ffb admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:18.983249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761305-9603-405c-8911-9ec72cdb8ffb admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:18.987982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbecccd-b2c9-43f2-92f7-0a1697eb1e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:18.988644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbecccd-b2c9-43f2-92f7-0a1697eb1e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:18.988931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbecccd-b2c9-43f2-92f7-0a1697eb1e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:18.989207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbecccd-b2c9-43f2-92f7-0a1697eb1e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:18.990021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbecccd-b2c9-43f2-92f7-0a1697eb1e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:18.991704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbecccd-b2c9-43f2-92f7-0a1697eb1e1e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:19.009492 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1144/2263] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:18 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:19.017169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ca4f4-48f6-419c-9c17-16b86212ec4a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:19.029505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ca4f4-48f6-419c-9c17-16b86212ec4a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:19.034301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70742e-c7a5-4db3-8efb-4071b08962ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:19.035809 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70742e-c7a5-4db3-8efb-4071b08962ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.036102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70742e-c7a5-4db3-8efb-4071b08962ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.036379 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70742e-c7a5-4db3-8efb-4071b08962ab admin admin] PATH_INFO: `/v3/projects/576f7a1f9af04493bfd4acffaa672357/users/c28bb8906e224012b58b2599a0b78275/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.059454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70742e-c7a5-4db3-8efb-4071b08962ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=576f7a1f9af04493bfd4acffaa672357, user_id=c28bb8906e224012b58b2599a0b78275, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:19.062227 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70742e-c7a5-4db3-8efb-4071b08962ab admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:19.076733 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1120/2264] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:19 2021] PUT /identity/v3/projects/576f7a1f9af04493bfd4acffaa672357/users/c28bb8906e224012b58b2599a0b78275/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:19.085998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbecccd-b2c9-43f2-92f7-0a1697eb1e1e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:19.088214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee530af-2d3f-48fb-962e-cfc991a1babe None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.088867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2cbecccd-b2c9-43f2-92f7-0a1697eb1e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:19.093453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee530af-2d3f-48fb-962e-cfc991a1babe None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.093852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee530af-2d3f-48fb-962e-cfc991a1babe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.105125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbecccd-b2c9-43f2-92f7-0a1697eb1e1e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:19.120927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-bee530af-2d3f-48fb-962e-cfc991a1babe None None] MFA Rules not processed for user `c28bb8906e224012b58b2599a0b78275`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:19.122162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-bee530af-2d3f-48fb-962e-cfc991a1babe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:19.173564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:19.174588 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.175013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.175453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] PATH_INFO: `/v3/projects/f1aacb519b0649138b2c02980de265b9` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.177329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1aacb519b0649138b2c02980de265b9)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:19.179753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:19.189281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1121/2265] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:19 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:19.193669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee530af-2d3f-48fb-962e-cfc991a1babe None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:19.206322 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee530af-2d3f-48fb-962e-cfc991a1babe None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:19.217500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0af25-b289-4570-b602-45a579187dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:19.218465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0af25-b289-4570-b602-45a579187dba admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.220286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0af25-b289-4570-b602-45a579187dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.220286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0af25-b289-4570-b602-45a579187dba admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.220286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0af25-b289-4570-b602-45a579187dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:19.221919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0af25-b289-4570-b602-45a579187dba admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:19.247830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1aacb519b0649138b2c02980de265b9', 'request_id': 'req-138bedf2-c7f1-4bdc-88be-92adccd9da5f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:19.255546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1aacb519b0649138b2c02980de265b9', 'request_id': 'req-138bedf2-c7f1-4bdc-88be-92adccd9da5f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:19.261134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1122/2266] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:19 2021] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:38:19.262646 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0af25-b289-4570-b602-45a579187dba admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:19.265565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1aacb519b0649138b2c02980de265b9', 'request_id': 'req-138bedf2-c7f1-4bdc-88be-92adccd9da5f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:19.278070 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] The token cache is being invalidate because project f1aacb519b0649138b2c02980de265b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:19.278648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:19.279417 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:19.282019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1145/2267] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:19 2021] DELETE /identity/v3/projects/f1aacb519b0649138b2c02980de265b9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:38:19.353938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0af25-b289-4570-b602-45a579187dba admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:19.359890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf550a8-4c16-43c7-b617-7a4a602e438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:19.360552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf550a8-4c16-43c7-b617-7a4a602e438f admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.360840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf550a8-4c16-43c7-b617-7a4a602e438f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.361120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf550a8-4c16-43c7-b617-7a4a602e438f admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.361974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf550a8-4c16-43c7-b617-7a4a602e438f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:19.363902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf550a8-4c16-43c7-b617-7a4a602e438f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:19.388367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1123/2268] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:19 2021] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:38:19.392500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:19.394166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:19.482588 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bedf2-c7f1-4bdc-88be-92adccd9da5f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:19.487170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32c504-1a17-4341-989b-312a80b64719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:19.487830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32c504-1a17-4341-989b-312a80b64719 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.488111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32c504-1a17-4341-989b-312a80b64719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.488386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32c504-1a17-4341-989b-312a80b64719 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.489151 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32c504-1a17-4341-989b-312a80b64719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:19.490766 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32c504-1a17-4341-989b-312a80b64719 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:19.501873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1146/2269] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:19 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:38:19.505992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf550a8-4c16-43c7-b617-7a4a602e438f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:19.516282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf550a8-4c16-43c7-b617-7a4a602e438f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:19.520972 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ab40c-6df4-4fd1-9057-8a731e41fecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:19.521628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab40c-6df4-4fd1-9057-8a731e41fecb admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.521942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab40c-6df4-4fd1-9057-8a731e41fecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.522216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab40c-6df4-4fd1-9057-8a731e41fecb admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.522951 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ab40c-6df4-4fd1-9057-8a731e41fecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:19.524555 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ab40c-6df4-4fd1-9057-8a731e41fecb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:19.534719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1124/2270] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:19.538887 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32c504-1a17-4341-989b-312a80b64719 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:19.549302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32c504-1a17-4341-989b-312a80b64719 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:19.554099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9cf83-af4e-4235-8238-b5d65d4546f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:19.554981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9cf83-af4e-4235-8238-b5d65d4546f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.555264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9cf83-af4e-4235-8238-b5d65d4546f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.556044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9cf83-af4e-4235-8238-b5d65d4546f8 admin admin] PATH_INFO: `/v3/projects/c67f354d700846f7857dcc83921e0893/users/6f517cf94ed6437892a5a895917995ae/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.570563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9cf83-af4e-4235-8238-b5d65d4546f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67f354d700846f7857dcc83921e0893, user_id=6f517cf94ed6437892a5a895917995ae, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:19.574383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9cf83-af4e-4235-8238-b5d65d4546f8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:19.588527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1147/2271] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:19 2021] PUT /identity/v3/projects/c67f354d700846f7857dcc83921e0893/users/6f517cf94ed6437892a5a895917995ae/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:38:19.599716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428433d6-6870-4658-bba5-f4f787043834 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.600005 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428433d6-6870-4658-bba5-f4f787043834 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.600277 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428433d6-6870-4658-bba5-f4f787043834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.631106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-428433d6-6870-4658-bba5-f4f787043834 None None] MFA Rules not processed for user `6f517cf94ed6437892a5a895917995ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:19.632743 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-428433d6-6870-4658-bba5-f4f787043834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:19.706381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1125/2272] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:19 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:19.707591 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9cf83-af4e-4235-8238-b5d65d4546f8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:19.783853 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9cf83-af4e-4235-8238-b5d65d4546f8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:19.788754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7524734-e2cd-431a-8d81-6e655ba193d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:19.789453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7524734-e2cd-431a-8d81-6e655ba193d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.789734 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7524734-e2cd-431a-8d81-6e655ba193d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.790567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7524734-e2cd-431a-8d81-6e655ba193d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.791277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7524734-e2cd-431a-8d81-6e655ba193d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:19.795251 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7524734-e2cd-431a-8d81-6e655ba193d5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:19.829815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1148/2273] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:19 2021] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:19.831679 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428433d6-6870-4658-bba5-f4f787043834 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:19.844338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428433d6-6870-4658-bba5-f4f787043834 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:19.919142 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfded9-9564-45a4-b40a-d5c0cee3b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:19.919959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfded9-9564-45a4-b40a-d5c0cee3b893 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.920607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfded9-9564-45a4-b40a-d5c0cee3b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.920607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfded9-9564-45a4-b40a-d5c0cee3b893 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.921407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfded9-9564-45a4-b40a-d5c0cee3b893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:19.923902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfded9-9564-45a4-b40a-d5c0cee3b893 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:19.945801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1126/2274] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:19 2021] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:19.948919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7524734-e2cd-431a-8d81-6e655ba193d5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:19.959912 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7524734-e2cd-431a-8d81-6e655ba193d5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:19.965173 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce83ab5-ce29-4147-8477-c3b65be690f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:19.966177 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83ab5-ce29-4147-8477-c3b65be690f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:19.966177 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83ab5-ce29-4147-8477-c3b65be690f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:19.966423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83ab5-ce29-4147-8477-c3b65be690f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:19.967123 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce83ab5-ce29-4147-8477-c3b65be690f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:19.968691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce83ab5-ce29-4147-8477-c3b65be690f8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:19.980669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1149/2275] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:19 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:19.984774 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfded9-9564-45a4-b40a-d5c0cee3b893 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:19.997998 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfded9-9564-45a4-b40a-d5c0cee3b893 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:20.003275 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab708f-7458-4c4d-a423-3642a3ba8a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:20.004398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab708f-7458-4c4d-a423-3642a3ba8a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:20.004741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab708f-7458-4c4d-a423-3642a3ba8a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:20.005085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab708f-7458-4c4d-a423-3642a3ba8a19 admin admin] PATH_INFO: `/v3/projects/93fe8938ada94ead9c4536d2d89ee355/users/53939c0c175c432e9486ae77c9534e59/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:20.022906 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab708f-7458-4c4d-a423-3642a3ba8a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fe8938ada94ead9c4536d2d89ee355, user_id=53939c0c175c432e9486ae77c9534e59, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:20.027316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab708f-7458-4c4d-a423-3642a3ba8a19 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:20.044082 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1127/2276] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:19 2021] PUT /identity/v3/projects/93fe8938ada94ead9c4536d2d89ee355/users/53939c0c175c432e9486ae77c9534e59/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:20.048408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce83ab5-ce29-4147-8477-c3b65be690f8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:20.060711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce83ab5-ce29-4147-8477-c3b65be690f8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:20.129082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc8cbe-39ca-4d73-87d7-7e0c1e99294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:20.129943 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8cbe-39ca-4d73-87d7-7e0c1e99294e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:20.130227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8cbe-39ca-4d73-87d7-7e0c1e99294e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:20.130505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8cbe-39ca-4d73-87d7-7e0c1e99294e admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:20.131248 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc8cbe-39ca-4d73-87d7-7e0c1e99294e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:20.132823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc8cbe-39ca-4d73-87d7-7e0c1e99294e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:20.146891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1150/2277] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:20 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:20.150201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab708f-7458-4c4d-a423-3642a3ba8a19 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:20.160645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab708f-7458-4c4d-a423-3642a3ba8a19 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:20.165543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f5d78-6ff8-4afa-8c80-6af387ca2019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:20.166471 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f5d78-6ff8-4afa-8c80-6af387ca2019 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:20.166750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f5d78-6ff8-4afa-8c80-6af387ca2019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:20.167022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f5d78-6ff8-4afa-8c80-6af387ca2019 admin admin] PATH_INFO: `/v3/projects/93fe8938ada94ead9c4536d2d89ee355/users/53939c0c175c432e9486ae77c9534e59/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:20.168974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f5d78-6ff8-4afa-8c80-6af387ca2019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fe8938ada94ead9c4536d2d89ee355, user_id=53939c0c175c432e9486ae77c9534e59, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:20.171635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f5d78-6ff8-4afa-8c80-6af387ca2019 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:20.183163 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1128/2278] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:20 2021] PUT /identity/v3/projects/93fe8938ada94ead9c4536d2d89ee355/users/53939c0c175c432e9486ae77c9534e59/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:20.193186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2814bd-1371-4414-9c3b-0ac25a08da58 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:20.193530 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2814bd-1371-4414-9c3b-0ac25a08da58 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:20.193782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2814bd-1371-4414-9c3b-0ac25a08da58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:20.221065 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-bd2814bd-1371-4414-9c3b-0ac25a08da58 None None] MFA Rules not processed for user `53939c0c175c432e9486ae77c9534e59`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:20.222305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bd2814bd-1371-4414-9c3b-0ac25a08da58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:20.291751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1151/2279] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:20 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:20.302208 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f5d78-6ff8-4afa-8c80-6af387ca2019 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:20.303887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9d3f5d78-6ff8-4afa-8c80-6af387ca2019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:20.361534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f5d78-6ff8-4afa-8c80-6af387ca2019 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:20.365243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94d96b-5e42-4331-8119-6eeb562196e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:20.365920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94d96b-5e42-4331-8119-6eeb562196e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:20.366206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94d96b-5e42-4331-8119-6eeb562196e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:20.366483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94d96b-5e42-4331-8119-6eeb562196e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:20.368817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-cc94d96b-5e42-4331-8119-6eeb562196e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:20.428577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94d96b-5e42-4331-8119-6eeb562196e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:20.430042 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94d96b-5e42-4331-8119-6eeb562196e2 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:20.445075 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1129/2280] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:20 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:21.625712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2814bd-1371-4414-9c3b-0ac25a08da58 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:21.627193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bd2814bd-1371-4414-9c3b-0ac25a08da58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:21.697529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2814bd-1371-4414-9c3b-0ac25a08da58 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:21.702189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:21.703072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:21.703332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:21.703607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] PATH_INFO: `/v3/users/7bd6fb5c7de34c28a3569f587da8a947` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:21.705088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd6fb5c7de34c28a3569f587da8a947)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:21.707009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:21.762546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd6fb5c7de34c28a3569f587da8a947'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:21.769365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd6fb5c7de34c28a3569f587da8a947'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:21.770071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd6fb5c7de34c28a3569f587da8a947'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:21.782343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd6fb5c7de34c28a3569f587da8a947'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:21.782948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd6fb5c7de34c28a3569f587da8a947'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:21.798841 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1152/2281] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:21 2021] DELETE /identity/v3/users/7bd6fb5c7de34c28a3569f587da8a947 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:21.803503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8ac5-b210-46ae-b542-649b7c7f74fe None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:21.803973 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8ac5-b210-46ae-b542-649b7c7f74fe None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:21.804074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8ac5-b210-46ae-b542-649b7c7f74fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:21.828335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-fe6f8ac5-b210-46ae-b542-649b7c7f74fe None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:21.829358 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fe6f8ac5-b210-46ae-b542-649b7c7f74fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:21.906750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1130/2282] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:21.918424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:21.920145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:21.965282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f8ac5-b210-46ae-b542-649b7c7f74fe None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:21.967509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fe6f8ac5-b210-46ae-b542-649b7c7f74fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:21.986024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb288336-a27d-4ef6-94d8-e2805631088e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:21.989961 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbfe82-4eaf-4699-9970-1c0694e8bb4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:21.990708 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfe82-4eaf-4699-9970-1c0694e8bb4f service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:21.991056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfe82-4eaf-4699-9970-1c0694e8bb4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:21.991419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfe82-4eaf-4699-9970-1c0694e8bb4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:22.001894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbfe82-4eaf-4699-9970-1c0694e8bb4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:22.003671 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbfe82-4eaf-4699-9970-1c0694e8bb4f service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:22.014474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1153/2283] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:22.040979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f8ac5-b210-46ae-b542-649b7c7f74fe None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:22.044656 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517749e-c050-44de-ae0e-dde04603f4b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:22.045304 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517749e-c050-44de-ae0e-dde04603f4b7 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:22.045607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517749e-c050-44de-ae0e-dde04603f4b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:22.045964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517749e-c050-44de-ae0e-dde04603f4b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:22.047795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9517749e-c050-44de-ae0e-dde04603f4b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:22.131900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517749e-c050-44de-ae0e-dde04603f4b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:22.134292 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517749e-c050-44de-ae0e-dde04603f4b7 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:22.146393 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1131/2284] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:21 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:22.366067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbfe82-4eaf-4699-9970-1c0694e8bb4f service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:22.367628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a1cbfe82-4eaf-4699-9970-1c0694e8bb4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:22.389473 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbfe82-4eaf-4699-9970-1c0694e8bb4f service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:22.394366 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:22.395232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:22.395509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:22.395784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] PATH_INFO: `/v3/projects/32a1029fc4db4ca79968815087f0af5c` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:22.397040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a1029fc4db4ca79968815087f0af5c)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:22.398960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:22.449060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a1029fc4db4ca79968815087f0af5c', 'request_id': 'req-a323b671-629b-4bda-937a-0dd8f6c70315'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:22.455435 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a1029fc4db4ca79968815087f0af5c', 'request_id': 'req-a323b671-629b-4bda-937a-0dd8f6c70315'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:22.463733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a1029fc4db4ca79968815087f0af5c', 'request_id': 'req-a323b671-629b-4bda-937a-0dd8f6c70315'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:22.474725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] The token cache is being invalidate because project 32a1029fc4db4ca79968815087f0af5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:22.475068 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:22.475762 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:22.478072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1154/2285] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:22 2021] DELETE /identity/v3/projects/32a1029fc4db4ca79968815087f0af5c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:22.482246 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517749e-c050-44de-ae0e-dde04603f4b7 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:22.493280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517749e-c050-44de-ae0e-dde04603f4b7 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:22.570035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:22.570988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:22.571309 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:22.571660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] PATH_INFO: `/v3/users/8f0d3b1592ed4298b8abc219cb7573d5` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:22.572963 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0d3b1592ed4298b8abc219cb7573d5)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:22.575021 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:22.627081 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0d3b1592ed4298b8abc219cb7573d5'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:22.634746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0d3b1592ed4298b8abc219cb7573d5'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:22.642509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0d3b1592ed4298b8abc219cb7573d5'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:22.656210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0d3b1592ed4298b8abc219cb7573d5'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:22.656210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0d3b1592ed4298b8abc219cb7573d5'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:22.661745 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1132/2286] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:22 2021] DELETE /identity/v3/users/8f0d3b1592ed4298b8abc219cb7573d5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:22.729808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:22.731231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:22.806205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323b671-629b-4bda-937a-0dd8f6c70315 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:22.863930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecf8c6-2a99-4b2a-97b0-98af4baf9c21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:22.864586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecf8c6-2a99-4b2a-97b0-98af4baf9c21 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:22.865002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecf8c6-2a99-4b2a-97b0-98af4baf9c21 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:22.865284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecf8c6-2a99-4b2a-97b0-98af4baf9c21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:22.867160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bcecf8c6-2a99-4b2a-97b0-98af4baf9c21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:22.947349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecf8c6-2a99-4b2a-97b0-98af4baf9c21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:22.948766 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecf8c6-2a99-4b2a-97b0-98af4baf9c21 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:22.959383 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:22.961972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1155/2287] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:22 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:22.969113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:23.055324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a240c8-8143-4b67-a039-4ee019046212 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:23.061479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:23.062492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.062799 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.063207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] PATH_INFO: `/v3/projects/3f1c259827da4c61bffa242e53397930` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.066949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1c259827da4c61bffa242e53397930)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:23.069576 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:23.122677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1c259827da4c61bffa242e53397930', 'request_id': 'req-911007dd-e073-48c9-a977-be64e1ff28e8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:23.129135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1c259827da4c61bffa242e53397930', 'request_id': 'req-911007dd-e073-48c9-a977-be64e1ff28e8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:23.137695 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1c259827da4c61bffa242e53397930', 'request_id': 'req-911007dd-e073-48c9-a977-be64e1ff28e8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:23.149420 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] The token cache is being invalidate because project 3f1c259827da4c61bffa242e53397930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:23.149562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:23.150246 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-911007dd-e073-48c9-a977-be64e1ff28e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:23.153438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1133/2288] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:22 2021] DELETE /identity/v3/projects/3f1c259827da4c61bffa242e53397930 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:23.160822 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b2ed0-af06-4cc4-bbc5-bde806529d50 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.161114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b2ed0-af06-4cc4-bbc5-bde806529d50 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.161397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b2ed0-af06-4cc4-bbc5-bde806529d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.181279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-853b2ed0-af06-4cc4-bbc5-bde806529d50 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:23.182648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-853b2ed0-af06-4cc4-bbc5-bde806529d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:23.243543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1156/2289] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:38:23.251993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b829a-b0e4-4c17-9b91-ac2f4c167976 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.252281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b829a-b0e4-4c17-9b91-ac2f4c167976 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.252558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b829a-b0e4-4c17-9b91-ac2f4c167976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.274509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e70b829a-b0e4-4c17-9b91-ac2f4c167976 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:23.275719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e70b829a-b0e4-4c17-9b91-ac2f4c167976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:23.283744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1134/2290] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:38:23.289114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b2ed0-af06-4cc4-bbc5-bde806529d50 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:23.299133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b2ed0-af06-4cc4-bbc5-bde806529d50 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:23.304362 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf80047-6775-4390-9cba-5f5cf9593a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:23.305014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf80047-6775-4390-9cba-5f5cf9593a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.305296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf80047-6775-4390-9cba-5f5cf9593a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.306139 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf80047-6775-4390-9cba-5f5cf9593a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.307114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf80047-6775-4390-9cba-5f5cf9593a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:38:23.307432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf80047-6775-4390-9cba-5f5cf9593a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:23.309024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf80047-6775-4390-9cba-5f5cf9593a8b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:23.322888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1157/2291] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:38:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:38:23.327717 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b829a-b0e4-4c17-9b91-ac2f4c167976 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:23.338260 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b829a-b0e4-4c17-9b91-ac2f4c167976 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:23.343146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac6ba-68a3-4468-ad91-f9244365e831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:23.343893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac6ba-68a3-4468-ad91-f9244365e831 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.344237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac6ba-68a3-4468-ad91-f9244365e831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.344639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac6ba-68a3-4468-ad91-f9244365e831 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.345434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac6ba-68a3-4468-ad91-f9244365e831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:23.347443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac6ba-68a3-4468-ad91-f9244365e831 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:23.389971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1135/2292] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:23 2021] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:23.390697 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf80047-6775-4390-9cba-5f5cf9593a8b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:23.400917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf80047-6775-4390-9cba-5f5cf9593a8b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:23.459320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb5883-e5df-40f5-b319-2bcf617770b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:23.459997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb5883-e5df-40f5-b319-2bcf617770b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.460277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb5883-e5df-40f5-b319-2bcf617770b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.460552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb5883-e5df-40f5-b319-2bcf617770b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.461254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb5883-e5df-40f5-b319-2bcf617770b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:23.463316 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb5883-e5df-40f5-b319-2bcf617770b3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:23.484128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1158/2293] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:23 2021] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:23.488941 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac6ba-68a3-4468-ad91-f9244365e831 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:23.500105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac6ba-68a3-4468-ad91-f9244365e831 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:23.505379 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf04522-c24b-488f-9b14-355459bc8c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:23.506073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf04522-c24b-488f-9b14-355459bc8c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.506353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf04522-c24b-488f-9b14-355459bc8c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.506627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf04522-c24b-488f-9b14-355459bc8c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.507362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf04522-c24b-488f-9b14-355459bc8c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:23.508976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf04522-c24b-488f-9b14-355459bc8c4f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:23.520227 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1136/2294] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:38:23.524216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb5883-e5df-40f5-b319-2bcf617770b3 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:23.534189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb5883-e5df-40f5-b319-2bcf617770b3 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:23.538785 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101b698-0904-4094-a885-cc9dd80ee454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:23.539436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101b698-0904-4094-a885-cc9dd80ee454 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.539721 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101b698-0904-4094-a885-cc9dd80ee454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.540482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101b698-0904-4094-a885-cc9dd80ee454 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.541254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101b698-0904-4094-a885-cc9dd80ee454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:23.542857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101b698-0904-4094-a885-cc9dd80ee454 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:23.555587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1159/2295] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:23.560535 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf04522-c24b-488f-9b14-355459bc8c4f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:23.571014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf04522-c24b-488f-9b14-355459bc8c4f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:23.575987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a573-613b-4cb8-9d42-b0da649db461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:23.577172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a573-613b-4cb8-9d42-b0da649db461 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.577452 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a573-613b-4cb8-9d42-b0da649db461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.577810 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a573-613b-4cb8-9d42-b0da649db461 admin admin] PATH_INFO: `/v3/projects/4ad649419e884439bc0455c4cc01f4cb/users/0cee0976ea51479790bcf00d21ffbecb/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.592934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013a573-613b-4cb8-9d42-b0da649db461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad649419e884439bc0455c4cc01f4cb, user_id=0cee0976ea51479790bcf00d21ffbecb, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:23.595638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013a573-613b-4cb8-9d42-b0da649db461 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:23.609599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1137/2296] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:23 2021] PUT /identity/v3/projects/4ad649419e884439bc0455c4cc01f4cb/users/0cee0976ea51479790bcf00d21ffbecb/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:23.621305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24db7-4726-4406-8353-05781b51f8ce None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.621663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24db7-4726-4406-8353-05781b51f8ce None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.621923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24db7-4726-4406-8353-05781b51f8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.648133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-04a24db7-4726-4406-8353-05781b51f8ce None None] MFA Rules not processed for user `0cee0976ea51479790bcf00d21ffbecb`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:23.649328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-04a24db7-4726-4406-8353-05781b51f8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:23.716786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1160/2297] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:23 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:23.721313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a573-613b-4cb8-9d42-b0da649db461 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:23.782468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a573-613b-4cb8-9d42-b0da649db461 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:23.787895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d002e-b30a-4c81-aecd-d5b59b25e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:23.788586 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d002e-b30a-4c81-aecd-d5b59b25e388 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.788873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d002e-b30a-4c81-aecd-d5b59b25e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.789134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d002e-b30a-4c81-aecd-d5b59b25e388 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.790553 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d002e-b30a-4c81-aecd-d5b59b25e388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:23.792430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d002e-b30a-4c81-aecd-d5b59b25e388 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:23.818150 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1138/2298] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:23 2021] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:23.822275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24db7-4726-4406-8353-05781b51f8ce None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:23.833568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24db7-4726-4406-8353-05781b51f8ce None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:23.889703 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49a505-20be-45e9-a06a-e393bd5dc879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:23.890403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49a505-20be-45e9-a06a-e393bd5dc879 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.890687 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49a505-20be-45e9-a06a-e393bd5dc879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.890963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49a505-20be-45e9-a06a-e393bd5dc879 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.891667 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49a505-20be-45e9-a06a-e393bd5dc879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:23.893569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49a505-20be-45e9-a06a-e393bd5dc879 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:23.912555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1161/2299] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:23 2021] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:23.917279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d002e-b30a-4c81-aecd-d5b59b25e388 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:23.927320 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d002e-b30a-4c81-aecd-d5b59b25e388 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:23.931962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9848a4-84e3-46c8-b049-d3a4dfdcd09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:23.932616 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9848a4-84e3-46c8-b049-d3a4dfdcd09d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.932899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9848a4-84e3-46c8-b049-d3a4dfdcd09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.933174 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9848a4-84e3-46c8-b049-d3a4dfdcd09d admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.934198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9848a4-84e3-46c8-b049-d3a4dfdcd09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:23.935779 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9848a4-84e3-46c8-b049-d3a4dfdcd09d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:23.948090 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1139/2300] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:23.950579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49a505-20be-45e9-a06a-e393bd5dc879 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:23.960668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49a505-20be-45e9-a06a-e393bd5dc879 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:23.965831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eaada-84e5-4114-9e13-264cf829d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:23.966711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eaada-84e5-4114-9e13-264cf829d896 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:23.966991 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eaada-84e5-4114-9e13-264cf829d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:23.967271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eaada-84e5-4114-9e13-264cf829d896 admin admin] PATH_INFO: `/v3/projects/3269a019d7d34e4b95eabeec81fd9366/users/dc06b5f847e34a43a050ada2f61dacd8/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:23.982770 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578eaada-84e5-4114-9e13-264cf829d896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3269a019d7d34e4b95eabeec81fd9366, user_id=dc06b5f847e34a43a050ada2f61dacd8, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:23.985524 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578eaada-84e5-4114-9e13-264cf829d896 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:23.999319 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1162/2301] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:23 2021] PUT /identity/v3/projects/3269a019d7d34e4b95eabeec81fd9366/users/dc06b5f847e34a43a050ada2f61dacd8/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:24.003557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9848a4-84e3-46c8-b049-d3a4dfdcd09d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:24.014923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9848a4-84e3-46c8-b049-d3a4dfdcd09d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:24.078211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aff414-b43c-4953-84fc-9bae2bf54987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:24.078877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aff414-b43c-4953-84fc-9bae2bf54987 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:24.079153 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aff414-b43c-4953-84fc-9bae2bf54987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:24.079497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aff414-b43c-4953-84fc-9bae2bf54987 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:24.080223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aff414-b43c-4953-84fc-9bae2bf54987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:24.081818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aff414-b43c-4953-84fc-9bae2bf54987 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:24.092569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1140/2302] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:24 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:24.096564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eaada-84e5-4114-9e13-264cf829d896 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:24.111386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eaada-84e5-4114-9e13-264cf829d896 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:24.119189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddc18f-4634-45f2-a417-d7382588fbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:24.120550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddc18f-4634-45f2-a417-d7382588fbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:24.120929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddc18f-4634-45f2-a417-d7382588fbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:24.121381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddc18f-4634-45f2-a417-d7382588fbd0 admin admin] PATH_INFO: `/v3/projects/3269a019d7d34e4b95eabeec81fd9366/users/dc06b5f847e34a43a050ada2f61dacd8/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:24.123564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddc18f-4634-45f2-a417-d7382588fbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3269a019d7d34e4b95eabeec81fd9366, user_id=dc06b5f847e34a43a050ada2f61dacd8, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:24.126445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddc18f-4634-45f2-a417-d7382588fbd0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:24.137863 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1163/2303] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:24 2021] PUT /identity/v3/projects/3269a019d7d34e4b95eabeec81fd9366/users/dc06b5f847e34a43a050ada2f61dacd8/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:24.147803 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95392-42d8-4c25-9242-5f75d89f937e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:24.148087 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95392-42d8-4c25-9242-5f75d89f937e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:24.148358 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95392-42d8-4c25-9242-5f75d89f937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:24.189158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-78f95392-42d8-4c25-9242-5f75d89f937e None None] MFA Rules not processed for user `dc06b5f847e34a43a050ada2f61dacd8`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:24.190399 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-78f95392-42d8-4c25-9242-5f75d89f937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:24.286220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1141/2304] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:24 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:24.296410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddc18f-4634-45f2-a417-d7382588fbd0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:24.298862 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-38ddc18f-4634-45f2-a417-d7382588fbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:24.391559 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddc18f-4634-45f2-a417-d7382588fbd0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:24.398433 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903257fe-9ddc-4a07-a18f-035f8c72b38e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:24.400720 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903257fe-9ddc-4a07-a18f-035f8c72b38e service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:24.401001 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903257fe-9ddc-4a07-a18f-035f8c72b38e service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:24.401273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903257fe-9ddc-4a07-a18f-035f8c72b38e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:24.412132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903257fe-9ddc-4a07-a18f-035f8c72b38e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:24.413661 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903257fe-9ddc-4a07-a18f-035f8c72b38e service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:24.440085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1164/2305] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:24 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:24.522792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95392-42d8-4c25-9242-5f75d89f937e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:24.532562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95392-42d8-4c25-9242-5f75d89f937e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:24.538463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf78f1-34cf-48a3-b0ad-0241a6a01f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:24.539205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf78f1-34cf-48a3-b0ad-0241a6a01f88 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:24.539556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf78f1-34cf-48a3-b0ad-0241a6a01f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:24.539930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf78f1-34cf-48a3-b0ad-0241a6a01f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:24.598811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf78f1-34cf-48a3-b0ad-0241a6a01f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:24.600288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf78f1-34cf-48a3-b0ad-0241a6a01f88 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:24.610417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1142/2306] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:24 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:26.873814 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903257fe-9ddc-4a07-a18f-035f8c72b38e service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:26.875244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-903257fe-9ddc-4a07-a18f-035f8c72b38e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:26.939700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903257fe-9ddc-4a07-a18f-035f8c72b38e service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:26.944328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:26.945223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:26.945496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:26.945937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] PATH_INFO: `/v3/users/c28bb8906e224012b58b2599a0b78275` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:26.947661 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28bb8906e224012b58b2599a0b78275)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:26.949585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:26.998800 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28bb8906e224012b58b2599a0b78275'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.006491 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28bb8906e224012b58b2599a0b78275'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.007388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28bb8906e224012b58b2599a0b78275'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.020057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28bb8906e224012b58b2599a0b78275'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.020757 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28bb8906e224012b58b2599a0b78275'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.033968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1165/2307] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:26 2021] DELETE /identity/v3/users/c28bb8906e224012b58b2599a0b78275 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:27.038633 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fab94-a1c4-4093-bca3-363ab9903b72 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:27.039102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fab94-a1c4-4093-bca3-363ab9903b72 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:27.039350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fab94-a1c4-4093-bca3-363ab9903b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:27.057114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d95fab94-a1c4-4093-bca3-363ab9903b72 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:27.058349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d95fab94-a1c4-4093-bca3-363ab9903b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:27.120114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1143/2308] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:27.130112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:27.131505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:27.188543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebc95-a310-486c-9fbd-a0f17bf138de admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:27.192215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b7c8-269d-4a0d-a08d-3bbaa7a2c42a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:27.192848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b7c8-269d-4a0d-a08d-3bbaa7a2c42a service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:27.193124 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b7c8-269d-4a0d-a08d-3bbaa7a2c42a service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:27.193396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b7c8-269d-4a0d-a08d-3bbaa7a2c42a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:27.203521 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1b7c8-269d-4a0d-a08d-3bbaa7a2c42a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:27.205048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1b7c8-269d-4a0d-a08d-3bbaa7a2c42a service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:27.218118 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1166/2309] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:27.604057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fab94-a1c4-4093-bca3-363ab9903b72 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:27.605699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d95fab94-a1c4-4093-bca3-363ab9903b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:27.621876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fab94-a1c4-4093-bca3-363ab9903b72 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:27.647265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:27.648870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:27.649400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:27.649870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] PATH_INFO: `/v3/projects/576f7a1f9af04493bfd4acffaa672357` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:27.655886 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576f7a1f9af04493bfd4acffaa672357)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:27.659327 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:27.716326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576f7a1f9af04493bfd4acffaa672357', 'request_id': 'req-835e9bb6-85bb-4d3e-9b48-b85390668b14'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.722654 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576f7a1f9af04493bfd4acffaa672357', 'request_id': 'req-835e9bb6-85bb-4d3e-9b48-b85390668b14'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.731218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576f7a1f9af04493bfd4acffaa672357', 'request_id': 'req-835e9bb6-85bb-4d3e-9b48-b85390668b14'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.744145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] The token cache is being invalidate because project 576f7a1f9af04493bfd4acffaa672357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:27.744771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.752384 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.757280 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1144/2310] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:27 2021] DELETE /identity/v3/projects/576f7a1f9af04493bfd4acffaa672357 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:27.758312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b7c8-269d-4a0d-a08d-3bbaa7a2c42a service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:27.770866 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b7c8-269d-4a0d-a08d-3bbaa7a2c42a service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:27.844967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:27.846015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:27.846363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:27.846711 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] PATH_INFO: `/v3/users/6f517cf94ed6437892a5a895917995ae` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:27.847980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f517cf94ed6437892a5a895917995ae)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:27.850478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:27.902010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f517cf94ed6437892a5a895917995ae'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.912676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f517cf94ed6437892a5a895917995ae'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.913639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f517cf94ed6437892a5a895917995ae'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.931336 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f517cf94ed6437892a5a895917995ae'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.932406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f517cf94ed6437892a5a895917995ae'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:27.950611 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1167/2311] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:27 2021] DELETE /identity/v3/users/6f517cf94ed6437892a5a895917995ae => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:28.475649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:28.477892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:28.494162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e9bb6-85bb-4d3e-9b48-b85390668b14 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:28.562047 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:28.562922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:28.563203 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:28.563475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] PATH_INFO: `/v3/projects/c67f354d700846f7857dcc83921e0893` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:28.564716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67f354d700846f7857dcc83921e0893)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:28.566666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:28.621910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67f354d700846f7857dcc83921e0893', 'request_id': 'req-5529a5ad-712a-4d5d-9f88-b2b04e800152'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:28.628152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67f354d700846f7857dcc83921e0893', 'request_id': 'req-5529a5ad-712a-4d5d-9f88-b2b04e800152'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:28.636097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67f354d700846f7857dcc83921e0893', 'request_id': 'req-5529a5ad-712a-4d5d-9f88-b2b04e800152'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:28.649281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] The token cache is being invalidate because project c67f354d700846f7857dcc83921e0893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:28.649571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:28.650297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:28.655772 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1145/2312] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:28 2021] DELETE /identity/v3/projects/c67f354d700846f7857dcc83921e0893 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:28.659705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:28.661578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:28.678820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798748-797e-4a23-a522-f71459ec3f06 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:28.746101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b90043-e570-4b1d-b0d7-caaf69265df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:28.746981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b90043-e570-4b1d-b0d7-caaf69265df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:28.747266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b90043-e570-4b1d-b0d7-caaf69265df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:28.747542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b90043-e570-4b1d-b0d7-caaf69265df0 admin admin] PATH_INFO: `/v3/users/53939c0c175c432e9486ae77c9534e59` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:28.749096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b90043-e570-4b1d-b0d7-caaf69265df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53939c0c175c432e9486ae77c9534e59)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:28.757364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b90043-e570-4b1d-b0d7-caaf69265df0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:28.807052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-66b90043-e570-4b1d-b0d7-caaf69265df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53939c0c175c432e9486ae77c9534e59'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:28.815346 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-66b90043-e570-4b1d-b0d7-caaf69265df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53939c0c175c432e9486ae77c9534e59'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:28.816103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-66b90043-e570-4b1d-b0d7-caaf69265df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53939c0c175c432e9486ae77c9534e59'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:28.828567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-66b90043-e570-4b1d-b0d7-caaf69265df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53939c0c175c432e9486ae77c9534e59'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:28.830000 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-66b90043-e570-4b1d-b0d7-caaf69265df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53939c0c175c432e9486ae77c9534e59'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:28.844240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1168/2313] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:28 2021] DELETE /identity/v3/users/53939c0c175c432e9486ae77c9534e59 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:29.122698 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:29.124423 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:29.137340 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529a5ad-712a-4d5d-9f88-b2b04e800152 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:29.201285 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:29.202345 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.202624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.202897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] PATH_INFO: `/v3/projects/93fe8938ada94ead9c4536d2d89ee355` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.204093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93fe8938ada94ead9c4536d2d89ee355)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:29.206062 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:29.252514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93fe8938ada94ead9c4536d2d89ee355', 'request_id': 'req-0f917735-e7c6-40c0-a208-72e320e9f979'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:29.259320 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93fe8938ada94ead9c4536d2d89ee355', 'request_id': 'req-0f917735-e7c6-40c0-a208-72e320e9f979'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:29.268462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93fe8938ada94ead9c4536d2d89ee355', 'request_id': 'req-0f917735-e7c6-40c0-a208-72e320e9f979'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:29.283603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] The token cache is being invalidate because project 93fe8938ada94ead9c4536d2d89ee355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:29.284165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:29.285222 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0f917735-e7c6-40c0-a208-72e320e9f979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:29.287271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1146/2314] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:29 2021] DELETE /identity/v3/projects/93fe8938ada94ead9c4536d2d89ee355 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:29.293537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a183b-7403-4e49-bff3-27d968b3b5ab None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.294101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a183b-7403-4e49-bff3-27d968b3b5ab None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.294273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a183b-7403-4e49-bff3-27d968b3b5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.314464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-599a183b-7403-4e49-bff3-27d968b3b5ab None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:29.315756 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-599a183b-7403-4e49-bff3-27d968b3b5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:29.386187 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1169/2315] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:29.394247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c099-34e4-4e6e-a35b-49df5e6fb25a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.394562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c099-34e4-4e6e-a35b-49df5e6fb25a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.394845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c099-34e4-4e6e-a35b-49df5e6fb25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.426546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d477c099-34e4-4e6e-a35b-49df5e6fb25a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:29.428256 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d477c099-34e4-4e6e-a35b-49df5e6fb25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:29.438460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1147/2316] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:29.443019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a183b-7403-4e49-bff3-27d968b3b5ab None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:29.446931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477c099-34e4-4e6e-a35b-49df5e6fb25a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:29.448311 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d477c099-34e4-4e6e-a35b-49df5e6fb25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:29.454193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a183b-7403-4e49-bff3-27d968b3b5ab None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:29.459344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f03731-4bf6-4386-99c4-c5f5d1c1a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:29.460048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f03731-4bf6-4386-99c4-c5f5d1c1a43f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.460262 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f03731-4bf6-4386-99c4-c5f5d1c1a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.460535 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f03731-4bf6-4386-99c4-c5f5d1c1a43f admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.460774 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477c099-34e4-4e6e-a35b-49df5e6fb25a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:29.461329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f03731-4bf6-4386-99c4-c5f5d1c1a43f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:38:29.461585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f03731-4bf6-4386-99c4-c5f5d1c1a43f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:29.463217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f03731-4bf6-4386-99c4-c5f5d1c1a43f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:29.472262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be99481-870e-47d4-8dcf-50d522dcd875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:29.473116 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be99481-870e-47d4-8dcf-50d522dcd875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.473399 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be99481-870e-47d4-8dcf-50d522dcd875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.473675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be99481-870e-47d4-8dcf-50d522dcd875 admin admin] PATH_INFO: `/v3/users/0cee0976ea51479790bcf00d21ffbecb` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.474977 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be99481-870e-47d4-8dcf-50d522dcd875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cee0976ea51479790bcf00d21ffbecb)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:29.479883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1170/2317] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:38:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:38:29.480031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be99481-870e-47d4-8dcf-50d522dcd875 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:29.480985 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f03731-4bf6-4386-99c4-c5f5d1c1a43f admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:29.492125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f03731-4bf6-4386-99c4-c5f5d1c1a43f admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:29.497674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86786-8501-4a3f-8207-0f80ca93eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:29.498389 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86786-8501-4a3f-8207-0f80ca93eecd admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.498646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86786-8501-4a3f-8207-0f80ca93eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.498941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86786-8501-4a3f-8207-0f80ca93eecd admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.499637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d86786-8501-4a3f-8207-0f80ca93eecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:29.501549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d86786-8501-4a3f-8207-0f80ca93eecd admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:29.533412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7be99481-870e-47d4-8dcf-50d522dcd875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cee0976ea51479790bcf00d21ffbecb'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:29.534952 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1171/2318] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:29 2021] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:29.542522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7be99481-870e-47d4-8dcf-50d522dcd875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cee0976ea51479790bcf00d21ffbecb'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:29.545035 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86786-8501-4a3f-8207-0f80ca93eecd admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:29.551134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7be99481-870e-47d4-8dcf-50d522dcd875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cee0976ea51479790bcf00d21ffbecb'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:29.564168 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7be99481-870e-47d4-8dcf-50d522dcd875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cee0976ea51479790bcf00d21ffbecb'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:29.564983 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-7be99481-870e-47d4-8dcf-50d522dcd875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cee0976ea51479790bcf00d21ffbecb'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:29.570961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1148/2319] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:29 2021] DELETE /identity/v3/users/0cee0976ea51479790bcf00d21ffbecb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:29.575247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180acde-b314-4ad7-9d3d-6950eea7ca5d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.575547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180acde-b314-4ad7-9d3d-6950eea7ca5d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.575829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180acde-b314-4ad7-9d3d-6950eea7ca5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.597574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d180acde-b314-4ad7-9d3d-6950eea7ca5d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:29.598996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d180acde-b314-4ad7-9d3d-6950eea7ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:29.613506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86786-8501-4a3f-8207-0f80ca93eecd admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:29.666406 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1149/2320] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:38:29.676396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180acde-b314-4ad7-9d3d-6950eea7ca5d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:29.676616 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cd96e-1bdd-4d11-8fc2-24108c8a5659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:29.677290 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cd96e-1bdd-4d11-8fc2-24108c8a5659 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.677568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cd96e-1bdd-4d11-8fc2-24108c8a5659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.677866 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cd96e-1bdd-4d11-8fc2-24108c8a5659 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.678082 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d180acde-b314-4ad7-9d3d-6950eea7ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:29.678566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cd96e-1bdd-4d11-8fc2-24108c8a5659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:29.680457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cd96e-1bdd-4d11-8fc2-24108c8a5659 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:29.704814 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1172/2321] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:29 2021] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:38:29.711247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cd96e-1bdd-4d11-8fc2-24108c8a5659 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:29.714245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7c2cd96e-1bdd-4d11-8fc2-24108c8a5659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:29.734673 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cd96e-1bdd-4d11-8fc2-24108c8a5659 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:29.742618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceedba5-6fa4-460e-a8e1-bb5decbd5834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:29.743398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceedba5-6fa4-460e-a8e1-bb5decbd5834 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.743638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceedba5-6fa4-460e-a8e1-bb5decbd5834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.743914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceedba5-6fa4-460e-a8e1-bb5decbd5834 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.744401 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180acde-b314-4ad7-9d3d-6950eea7ca5d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:29.744663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceedba5-6fa4-460e-a8e1-bb5decbd5834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:29.746268 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceedba5-6fa4-460e-a8e1-bb5decbd5834 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:29.748048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb412a-96e6-4477-8bf6-2380bceff329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:29.748714 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb412a-96e6-4477-8bf6-2380bceff329 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.748999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb412a-96e6-4477-8bf6-2380bceff329 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.749264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb412a-96e6-4477-8bf6-2380bceff329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.757788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1173/2322] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:29 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:29.761486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceedba5-6fa4-460e-a8e1-bb5decbd5834 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:29.767814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb412a-96e6-4477-8bf6-2380bceff329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:29.769271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb412a-96e6-4477-8bf6-2380bceff329 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:29.771341 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceedba5-6fa4-460e-a8e1-bb5decbd5834 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:29.776930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700ccea-bd7e-4dff-869d-6206f1df863a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:29.777589 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700ccea-bd7e-4dff-869d-6206f1df863a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.777905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700ccea-bd7e-4dff-869d-6206f1df863a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.778184 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700ccea-bd7e-4dff-869d-6206f1df863a admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.778923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700ccea-bd7e-4dff-869d-6206f1df863a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:29.779488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1150/2323] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:38:29.780532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700ccea-bd7e-4dff-869d-6206f1df863a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:29.791320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1174/2324] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:38:29.795486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb412a-96e6-4477-8bf6-2380bceff329 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:29.805060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb412a-96e6-4477-8bf6-2380bceff329 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:29.809694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81d7bc-50b7-46c4-9ecb-7076a18c8678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:29.810596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81d7bc-50b7-46c4-9ecb-7076a18c8678 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.810873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81d7bc-50b7-46c4-9ecb-7076a18c8678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.811277 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81d7bc-50b7-46c4-9ecb-7076a18c8678 admin admin] PATH_INFO: `/v3/projects/0a22fa4f2d494f388339b70c8cc24946/users/d6859a06049348b1b75b37ac1cb212fb/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.828508 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81d7bc-50b7-46c4-9ecb-7076a18c8678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a22fa4f2d494f388339b70c8cc24946, user_id=d6859a06049348b1b75b37ac1cb212fb, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:29.831846 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81d7bc-50b7-46c4-9ecb-7076a18c8678 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:29.847357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1151/2325] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:29 2021] PUT /identity/v3/projects/0a22fa4f2d494f388339b70c8cc24946/users/d6859a06049348b1b75b37ac1cb212fb/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:29.859402 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e045fd0-c6f6-4eee-be24-671ee5dd8856 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:29.859789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e045fd0-c6f6-4eee-be24-671ee5dd8856 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:29.860136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e045fd0-c6f6-4eee-be24-671ee5dd8856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:29.892315 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-0e045fd0-c6f6-4eee-be24-671ee5dd8856 None None] MFA Rules not processed for user `d6859a06049348b1b75b37ac1cb212fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:29.895062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0e045fd0-c6f6-4eee-be24-671ee5dd8856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:29.971404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1175/2326] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:29 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:29.981506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81d7bc-50b7-46c4-9ecb-7076a18c8678 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:29.983273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-da81d7bc-50b7-46c4-9ecb-7076a18c8678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:30.046675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81d7bc-50b7-46c4-9ecb-7076a18c8678 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:30.050376 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be33ea-ac58-4b3a-9703-3e307f949876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:30.051034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be33ea-ac58-4b3a-9703-3e307f949876 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:30.051580 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be33ea-ac58-4b3a-9703-3e307f949876 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:30.051580 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be33ea-ac58-4b3a-9703-3e307f949876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:30.060985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be33ea-ac58-4b3a-9703-3e307f949876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:30.062944 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be33ea-ac58-4b3a-9703-3e307f949876 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:30.073898 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1152/2327] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:29 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:30.169396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e045fd0-c6f6-4eee-be24-671ee5dd8856 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:30.170951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0e045fd0-c6f6-4eee-be24-671ee5dd8856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:30.264617 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e045fd0-c6f6-4eee-be24-671ee5dd8856 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:30.270763 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:30.272233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:30.272517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:30.272798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] PATH_INFO: `/v3/projects/4ad649419e884439bc0455c4cc01f4cb` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:30.274200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad649419e884439bc0455c4cc01f4cb)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:30.276330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:30.345538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad649419e884439bc0455c4cc01f4cb', 'request_id': 'req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:30.356931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad649419e884439bc0455c4cc01f4cb', 'request_id': 'req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:30.374784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad649419e884439bc0455c4cc01f4cb', 'request_id': 'req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:30.387183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] The token cache is being invalidate because project 4ad649419e884439bc0455c4cc01f4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:30.387476 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:30.388139 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:30.389680 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1176/2328] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:30 2021] DELETE /identity/v3/projects/4ad649419e884439bc0455c4cc01f4cb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:30.393714 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be33ea-ac58-4b3a-9703-3e307f949876 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:30.405573 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be33ea-ac58-4b3a-9703-3e307f949876 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:30.484460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5567dbf-a85a-481f-819e-e147b8b89e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:30.485346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567dbf-a85a-481f-819e-e147b8b89e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:30.485622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567dbf-a85a-481f-819e-e147b8b89e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:30.485934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567dbf-a85a-481f-819e-e147b8b89e0b admin admin] PATH_INFO: `/v3/users/dc06b5f847e34a43a050ada2f61dacd8` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:30.487394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5567dbf-a85a-481f-819e-e147b8b89e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc06b5f847e34a43a050ada2f61dacd8)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:30.490934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5567dbf-a85a-481f-819e-e147b8b89e0b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:30.572047 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5567dbf-a85a-481f-819e-e147b8b89e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc06b5f847e34a43a050ada2f61dacd8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:30.583204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5567dbf-a85a-481f-819e-e147b8b89e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc06b5f847e34a43a050ada2f61dacd8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:30.593338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5567dbf-a85a-481f-819e-e147b8b89e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc06b5f847e34a43a050ada2f61dacd8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:30.620193 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5567dbf-a85a-481f-819e-e147b8b89e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc06b5f847e34a43a050ada2f61dacd8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:30.621061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f5567dbf-a85a-481f-819e-e147b8b89e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc06b5f847e34a43a050ada2f61dacd8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:30.630103 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1153/2329] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:30 2021] DELETE /identity/v3/users/dc06b5f847e34a43a050ada2f61dacd8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:30.941111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:30.942636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:30.964119 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffd1de-8dfc-43b8-9a0b-533f4e1d975a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:31.041973 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:31.043095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:31.043364 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:31.044421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] PATH_INFO: `/v3/projects/3269a019d7d34e4b95eabeec81fd9366` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:31.046228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3269a019d7d34e4b95eabeec81fd9366)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:31.048116 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:31.097250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3269a019d7d34e4b95eabeec81fd9366', 'request_id': 'req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:31.110325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3269a019d7d34e4b95eabeec81fd9366', 'request_id': 'req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:31.121391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3269a019d7d34e4b95eabeec81fd9366', 'request_id': 'req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:31.138798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] The token cache is being invalidate because project 3269a019d7d34e4b95eabeec81fd9366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:31.139084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:31.141155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1f605aa6-79c7-4d5e-8bdf-bf5e4133fd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:31.143428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1177/2330] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:30 2021] DELETE /identity/v3/projects/3269a019d7d34e4b95eabeec81fd9366 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:31.150330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcd949-3d60-4590-88ba-074796a22bcb None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:31.150330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcd949-3d60-4590-88ba-074796a22bcb None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:31.151241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcd949-3d60-4590-88ba-074796a22bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:31.199884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-23dcd949-3d60-4590-88ba-074796a22bcb None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:31.201891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-23dcd949-3d60-4590-88ba-074796a22bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:31.353722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1154/2331] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:38:31.366888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae13b2-9126-49f0-9a42-821cc3e4c6e0 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:31.367426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae13b2-9126-49f0-9a42-821cc3e4c6e0 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:31.367888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae13b2-9126-49f0-9a42-821cc3e4c6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:31.402561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2e22b-6dbe-40ca-bc63-35963a99f7a8 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:31.403118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2e22b-6dbe-40ca-bc63-35963a99f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:31.403626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2e22b-6dbe-40ca-bc63-35963a99f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:31.410152 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-9cae13b2-9126-49f0-9a42-821cc3e4c6e0 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:31.411618 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9cae13b2-9126-49f0-9a42-821cc3e4c6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:31.436176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-5ec2e22b-6dbe-40ca-bc63-35963a99f7a8 None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:31.437517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-5ec2e22b-6dbe-40ca-bc63-35963a99f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:31.440865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1178/2332] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:31.444596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae13b2-9126-49f0-9a42-821cc3e4c6e0 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:31.473051 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae13b2-9126-49f0-9a42-821cc3e4c6e0 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:31.490946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c91762-e7f0-471c-9751-f8aa9cd62d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:31.492596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c91762-e7f0-471c-9751-f8aa9cd62d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:31.493044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c91762-e7f0-471c-9751-f8aa9cd62d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:31.493523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c91762-e7f0-471c-9751-f8aa9cd62d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:31.494528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c91762-e7f0-471c-9751-f8aa9cd62d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:38:31.495029 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c91762-e7f0-471c-9751-f8aa9cd62d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:31.497099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c91762-e7f0-471c-9751-f8aa9cd62d77 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:31.510234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1155/2333] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:38:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:31.525507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1179/2334] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:38:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:38:31.530589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2e22b-6dbe-40ca-bc63-35963a99f7a8 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:31.544059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2e22b-6dbe-40ca-bc63-35963a99f7a8 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:31.549530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256bf2d-f1c6-4052-93d3-86502cba1ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:31.550361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256bf2d-f1c6-4052-93d3-86502cba1ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:31.550761 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256bf2d-f1c6-4052-93d3-86502cba1ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:31.551853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256bf2d-f1c6-4052-93d3-86502cba1ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:31.552881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256bf2d-f1c6-4052-93d3-86502cba1ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:31.555380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256bf2d-f1c6-4052-93d3-86502cba1ac8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:31.578169 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c91762-e7f0-471c-9751-f8aa9cd62d77 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:31.580185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c5c91762-e7f0-471c-9751-f8aa9cd62d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:31.605018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1156/2335] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:31 2021] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:31.610281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256bf2d-f1c6-4052-93d3-86502cba1ac8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:31.718189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c91762-e7f0-471c-9751-f8aa9cd62d77 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:31.750594 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256bf2d-f1c6-4052-93d3-86502cba1ac8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:31.756774 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216096f-4b89-4460-8270-51294378dc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:31.757862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216096f-4b89-4460-8270-51294378dc86 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:31.758475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216096f-4b89-4460-8270-51294378dc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:31.759610 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216096f-4b89-4460-8270-51294378dc86 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:31.761263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216096f-4b89-4460-8270-51294378dc86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:31.765338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216096f-4b89-4460-8270-51294378dc86 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:31.796723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1157/2336] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:31 2021] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:31.800862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216096f-4b89-4460-8270-51294378dc86 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:31.812165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bf882-b1d1-4f23-a0d6-09c834a6147b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:31.813069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bf882-b1d1-4f23-a0d6-09c834a6147b service swift] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:31.813663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bf882-b1d1-4f23-a0d6-09c834a6147b service swift] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:31.813977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bf882-b1d1-4f23-a0d6-09c834a6147b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:31.815950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216096f-4b89-4460-8270-51294378dc86 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:31.825612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0808f8-c5c3-4ae1-a08a-34d16d146616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:31.828162 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0808f8-c5c3-4ae1-a08a-34d16d146616 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:31.828662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0808f8-c5c3-4ae1-a08a-34d16d146616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:31.829666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0808f8-c5c3-4ae1-a08a-34d16d146616 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:31.830846 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0808f8-c5c3-4ae1-a08a-34d16d146616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:31.835436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0808f8-c5c3-4ae1-a08a-34d16d146616 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:31.863381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1158/2337] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:31.867593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0808f8-c5c3-4ae1-a08a-34d16d146616 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:31.897097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0808f8-c5c3-4ae1-a08a-34d16d146616 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:31.909311 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d686da5-0043-4e25-8391-2460eed7e34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:31.911374 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d686da5-0043-4e25-8391-2460eed7e34b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:31.911656 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d686da5-0043-4e25-8391-2460eed7e34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:31.911933 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d686da5-0043-4e25-8391-2460eed7e34b admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:31.912688 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d686da5-0043-4e25-8391-2460eed7e34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:31.919141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d686da5-0043-4e25-8391-2460eed7e34b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:31.944123 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1159/2338] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:38:31.945626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d686da5-0043-4e25-8391-2460eed7e34b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:31.948176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bf882-b1d1-4f23-a0d6-09c834a6147b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:31.949871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bf882-b1d1-4f23-a0d6-09c834a6147b service swift] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:31.963418 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1180/2339] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:38:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:38:31.969625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d686da5-0043-4e25-8391-2460eed7e34b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:31.984043 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ee1a1-3bff-4619-96dd-a7435a437fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:31.985925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee1a1-3bff-4619-96dd-a7435a437fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:31.986288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee1a1-3bff-4619-96dd-a7435a437fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:31.987660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee1a1-3bff-4619-96dd-a7435a437fbf admin admin] PATH_INFO: `/v3/projects/b3668af6214f497dbc0c3367ab543301/users/a52c574944424785bcbda90bf6b71f1a/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:32.034975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ee1a1-3bff-4619-96dd-a7435a437fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3668af6214f497dbc0c3367ab543301, user_id=a52c574944424785bcbda90bf6b71f1a, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:32.040505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ee1a1-3bff-4619-96dd-a7435a437fbf admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:32.080261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1160/2340] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:31 2021] PUT /identity/v3/projects/b3668af6214f497dbc0c3367ab543301/users/a52c574944424785bcbda90bf6b71f1a/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:32.091795 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa298494-9c3d-4f15-a9cb-5138dea5cbec None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:32.092238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa298494-9c3d-4f15-a9cb-5138dea5cbec None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:32.092380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa298494-9c3d-4f15-a9cb-5138dea5cbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:32.129534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-aa298494-9c3d-4f15-a9cb-5138dea5cbec None None] MFA Rules not processed for user `a52c574944424785bcbda90bf6b71f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:32.130959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-aa298494-9c3d-4f15-a9cb-5138dea5cbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:32.210179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1181/2341] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:32 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:32.220820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ee1a1-3bff-4619-96dd-a7435a437fbf admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:32.222655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-7f2ee1a1-3bff-4619-96dd-a7435a437fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:32.304003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ee1a1-3bff-4619-96dd-a7435a437fbf admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:32.312339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a54471-1609-4bcc-ab45-16666b0a160e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:32.313374 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a54471-1609-4bcc-ab45-16666b0a160e service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:32.313699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a54471-1609-4bcc-ab45-16666b0a160e service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:32.314157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a54471-1609-4bcc-ab45-16666b0a160e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:32.324950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a54471-1609-4bcc-ab45-16666b0a160e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:32.326382 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a54471-1609-4bcc-ab45-16666b0a160e service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:32.336169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1161/2342] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:32 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:38.440623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518f70-f45f-4c73-8555-578e4a143088 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:38.441249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518f70-f45f-4c73-8555-578e4a143088 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:38.441339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518f70-f45f-4c73-8555-578e4a143088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:38.478574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-93518f70-f45f-4c73-8555-578e4a143088 None None] MFA Rules not processed for user `7e3a3afdfc4c44a29d0f3df50a5ed2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:38.479842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-93518f70-f45f-4c73-8555-578e4a143088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:38.616423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1182/2343] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:38 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:45.114622 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a54471-1609-4bcc-ab45-16666b0a160e service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:45.116485 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-72a54471-1609-4bcc-ab45-16666b0a160e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:45.213553 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a54471-1609-4bcc-ab45-16666b0a160e service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:45.220245 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:45.221254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:45.221603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:45.222053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] PATH_INFO: `/v3/users/d6859a06049348b1b75b37ac1cb212fb` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:45.223457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6859a06049348b1b75b37ac1cb212fb)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:45.225847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:45.312762 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6859a06049348b1b75b37ac1cb212fb'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:45.333651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6859a06049348b1b75b37ac1cb212fb'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:45.343802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6859a06049348b1b75b37ac1cb212fb'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:45.380795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6859a06049348b1b75b37ac1cb212fb'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:45.381639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6859a06049348b1b75b37ac1cb212fb'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:45.394642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1162/2344] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:45 2021] DELETE /identity/v3/users/d6859a06049348b1b75b37ac1cb212fb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:45.399338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cb617-be18-4af5-aff9-53c81a9d54fd None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:45.399963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cb617-be18-4af5-aff9-53c81a9d54fd None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:45.399963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cb617-be18-4af5-aff9-53c81a9d54fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:45.439122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-4f7cb617-be18-4af5-aff9-53c81a9d54fd None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:45.451015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4f7cb617-be18-4af5-aff9-53c81a9d54fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:45.580010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1183/2345] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:45.589986 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:45.591488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:45.683012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22f43f-92da-4859-a295-451a949b14b1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:45.687188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a20107-fca5-4661-8aa1-cba43abb1fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:45.688190 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20107-fca5-4661-8aa1-cba43abb1fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:45.688527 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20107-fca5-4661-8aa1-cba43abb1fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:45.688812 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20107-fca5-4661-8aa1-cba43abb1fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:45.701168 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a20107-fca5-4661-8aa1-cba43abb1fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:45.703069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a20107-fca5-4661-8aa1-cba43abb1fd3 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:45.714960 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1163/2346] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:46.273266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cb617-be18-4af5-aff9-53c81a9d54fd None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:46.274835 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4f7cb617-be18-4af5-aff9-53c81a9d54fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:46.287373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cb617-be18-4af5-aff9-53c81a9d54fd None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:46.292526 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:46.293899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:46.294438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:46.294581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] PATH_INFO: `/v3/projects/0a22fa4f2d494f388339b70c8cc24946` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:46.295915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a22fa4f2d494f388339b70c8cc24946)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:46.297947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:46.363045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a22fa4f2d494f388339b70c8cc24946', 'request_id': 'req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:46.370199 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a22fa4f2d494f388339b70c8cc24946', 'request_id': 'req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:46.379603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a22fa4f2d494f388339b70c8cc24946', 'request_id': 'req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:46.391008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] The token cache is being invalidate because project 0a22fa4f2d494f388339b70c8cc24946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:46.391294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:46.391931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5e338eef-9f4d-4dd9-8efc-6c953ea4d430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:46.393510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1184/2347] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:46 2021] DELETE /identity/v3/projects/0a22fa4f2d494f388339b70c8cc24946 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:46.399329 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11869ec7-470b-4eb9-8a41-49cf0ab4ef4d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:46.399818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11869ec7-470b-4eb9-8a41-49cf0ab4ef4d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:46.399907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11869ec7-470b-4eb9-8a41-49cf0ab4ef4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:46.418274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-11869ec7-470b-4eb9-8a41-49cf0ab4ef4d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:46.419472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-11869ec7-470b-4eb9-8a41-49cf0ab4ef4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:46.476992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1164/2348] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:46.486198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce5384-b465-4d2c-b33b-3834aac20fc6 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:46.486681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce5384-b465-4d2c-b33b-3834aac20fc6 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:46.486772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce5384-b465-4d2c-b33b-3834aac20fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:46.505429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-54ce5384-b465-4d2c-b33b-3834aac20fc6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:46.506683 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-54ce5384-b465-4d2c-b33b-3834aac20fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:46.514748 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1185/2349] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:38:46.518978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11869ec7-470b-4eb9-8a41-49cf0ab4ef4d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:46.528625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11869ec7-470b-4eb9-8a41-49cf0ab4ef4d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:46.533134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753227c6-b09d-4fe4-84e9-2cc1bb5330c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:46.533796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753227c6-b09d-4fe4-84e9-2cc1bb5330c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:46.534078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753227c6-b09d-4fe4-84e9-2cc1bb5330c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:46.534347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753227c6-b09d-4fe4-84e9-2cc1bb5330c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:46.535073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753227c6-b09d-4fe4-84e9-2cc1bb5330c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:38:46.535375 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753227c6-b09d-4fe4-84e9-2cc1bb5330c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:46.536943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753227c6-b09d-4fe4-84e9-2cc1bb5330c4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:46.548568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1165/2350] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:38:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:38:46.552818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce5384-b465-4d2c-b33b-3834aac20fc6 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:46.562901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce5384-b465-4d2c-b33b-3834aac20fc6 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:46.567684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e7b12-ef25-4fa3-9e8b-96b940f2cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:46.568343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e7b12-ef25-4fa3-9e8b-96b940f2cdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:46.568624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e7b12-ef25-4fa3-9e8b-96b940f2cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:46.568898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e7b12-ef25-4fa3-9e8b-96b940f2cdd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:46.569610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e7b12-ef25-4fa3-9e8b-96b940f2cdd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:46.571547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e7b12-ef25-4fa3-9e8b-96b940f2cdd6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:46.597502 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1186/2351] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:46 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:46.601676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753227c6-b09d-4fe4-84e9-2cc1bb5330c4 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:46.612567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753227c6-b09d-4fe4-84e9-2cc1bb5330c4 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:46.673080 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588a90e-ea53-4959-a809-e88441d62960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:46.673080 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588a90e-ea53-4959-a809-e88441d62960 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:46.673274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588a90e-ea53-4959-a809-e88441d62960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:46.673431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588a90e-ea53-4959-a809-e88441d62960 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:46.674174 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588a90e-ea53-4959-a809-e88441d62960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:46.676093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588a90e-ea53-4959-a809-e88441d62960 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:46.701426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1166/2352] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:46 2021] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:38:46.703042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e7b12-ef25-4fa3-9e8b-96b940f2cdd6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:46.717774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e7b12-ef25-4fa3-9e8b-96b940f2cdd6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:46.723285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb007b-32d5-49a1-880a-0eae2d0374d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:46.723955 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb007b-32d5-49a1-880a-0eae2d0374d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:46.724232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb007b-32d5-49a1-880a-0eae2d0374d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:46.724504 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb007b-32d5-49a1-880a-0eae2d0374d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:46.725240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb007b-32d5-49a1-880a-0eae2d0374d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:46.726852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb007b-32d5-49a1-880a-0eae2d0374d5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:46.737799 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1187/2353] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:46 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:46.741837 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588a90e-ea53-4959-a809-e88441d62960 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:46.753145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588a90e-ea53-4959-a809-e88441d62960 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:46.758157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce374-727f-4079-bf71-0bc3611b541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:46.758839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce374-727f-4079-bf71-0bc3611b541d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:46.759117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce374-727f-4079-bf71-0bc3611b541d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:46.759391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce374-727f-4079-bf71-0bc3611b541d admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:46.760120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ce374-727f-4079-bf71-0bc3611b541d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:46.761702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ce374-727f-4079-bf71-0bc3611b541d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:46.771438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1167/2354] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:38:46.776267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb007b-32d5-49a1-880a-0eae2d0374d5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:46.786291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb007b-32d5-49a1-880a-0eae2d0374d5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:46.792100 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05110b-e5cb-43c0-aab6-44af793dee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:46.792985 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05110b-e5cb-43c0-aab6-44af793dee84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:46.793265 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05110b-e5cb-43c0-aab6-44af793dee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:46.793544 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05110b-e5cb-43c0-aab6-44af793dee84 admin admin] PATH_INFO: `/v3/projects/ae0b248663174800af3db2a34d92f6b3/users/8fa045c5aa324b8a8e3f3d83437c706d/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:46.808013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05110b-e5cb-43c0-aab6-44af793dee84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0b248663174800af3db2a34d92f6b3, user_id=8fa045c5aa324b8a8e3f3d83437c706d, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:46.810693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05110b-e5cb-43c0-aab6-44af793dee84 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:46.823810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1188/2355] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:46 2021] PUT /identity/v3/projects/ae0b248663174800af3db2a34d92f6b3/users/8fa045c5aa324b8a8e3f3d83437c706d/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:46.829507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0314b2-e00c-4584-bffe-fb0874e0bf9d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:46.829876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0314b2-e00c-4584-bffe-fb0874e0bf9d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:46.830161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0314b2-e00c-4584-bffe-fb0874e0bf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:46.848096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-3d0314b2-e00c-4584-bffe-fb0874e0bf9d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:46.849297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3d0314b2-e00c-4584-bffe-fb0874e0bf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:46.906651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1168/2356] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:46.917454 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05110b-e5cb-43c0-aab6-44af793dee84 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:46.919188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0d05110b-e5cb-43c0-aab6-44af793dee84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:46.976765 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05110b-e5cb-43c0-aab6-44af793dee84 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:46.985084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4574c6-aee9-4527-a323-c5ba01362903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:46.986676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4574c6-aee9-4527-a323-c5ba01362903 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:46.986968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4574c6-aee9-4527-a323-c5ba01362903 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:46.987245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4574c6-aee9-4527-a323-c5ba01362903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:46.996915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4574c6-aee9-4527-a323-c5ba01362903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:46.998399 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4574c6-aee9-4527-a323-c5ba01362903 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:47.008046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1189/2357] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:51.077195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0314b2-e00c-4584-bffe-fb0874e0bf9d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:51.080388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3d0314b2-e00c-4584-bffe-fb0874e0bf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:51.095500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0314b2-e00c-4584-bffe-fb0874e0bf9d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:51.100973 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:51.102683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:51.103206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:51.103705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] PATH_INFO: `/v3/users/0e23c50746954d728cfc7423d1eeb061` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:51.105517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e23c50746954d728cfc7423d1eeb061)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:51.108143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:51.256389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e23c50746954d728cfc7423d1eeb061'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:51.275418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e23c50746954d728cfc7423d1eeb061'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:51.287704 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e23c50746954d728cfc7423d1eeb061'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:51.311530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e23c50746954d728cfc7423d1eeb061'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:51.312530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e23c50746954d728cfc7423d1eeb061'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:51.324124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1169/2358] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:51 2021] DELETE /identity/v3/users/0e23c50746954d728cfc7423d1eeb061 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:51.326074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8172e-62f9-482b-aa0b-c9b30ed7ca89 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:51.327056 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8172e-62f9-482b-aa0b-c9b30ed7ca89 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:51.327873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8172e-62f9-482b-aa0b-c9b30ed7ca89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:51.363359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-31d8172e-62f9-482b-aa0b-c9b30ed7ca89 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:51.366296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-31d8172e-62f9-482b-aa0b-c9b30ed7ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:51.506534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1190/2359] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:51.516353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:51.520415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:51.623314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a99a3-04f4-4860-a103-643dee4cf26f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:51.643973 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20b5bd-e110-4219-ab5b-0fe5ceb78715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:51.644783 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b5bd-e110-4219-ab5b-0fe5ceb78715 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:51.644954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b5bd-e110-4219-ab5b-0fe5ceb78715 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:51.645228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b5bd-e110-4219-ab5b-0fe5ceb78715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:51.663961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20b5bd-e110-4219-ab5b-0fe5ceb78715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:51.666501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20b5bd-e110-4219-ab5b-0fe5ceb78715 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:51.690859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1170/2360] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:52.392489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506562e-3b75-4f43-9ccb-b6e80c7c9eac None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:52.393048 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506562e-3b75-4f43-9ccb-b6e80c7c9eac None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:52.393172 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506562e-3b75-4f43-9ccb-b6e80c7c9eac None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:52.397262 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1191/2361] 10.222.0.83 () {54 vars in 921 bytes} [Wed Dec 15 13:38:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:38:52.410818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba682fb-7944-4168-ab19-40bf5ea77a78 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:52.411449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba682fb-7944-4168-ab19-40bf5ea77a78 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:52.411449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba682fb-7944-4168-ab19-40bf5ea77a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:52.447792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-9ba682fb-7944-4168-ab19-40bf5ea77a78 None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:52.449309 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9ba682fb-7944-4168-ab19-40bf5ea77a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:52.504783 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506562e-3b75-4f43-9ccb-b6e80c7c9eac None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:52.507195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1506562e-3b75-4f43-9ccb-b6e80c7c9eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:52.555420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506562e-3b75-4f43-9ccb-b6e80c7c9eac None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:52.567243 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:52.568562 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:52.569096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:52.569578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] PATH_INFO: `/v3/projects/d3bdab48838d4b81928d395160ab1d49` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:52.572479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3bdab48838d4b81928d395160ab1d49)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:52.576181 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:52.624399 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1171/2362] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Dec 15 13:38:52 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:52.656935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba682fb-7944-4168-ab19-40bf5ea77a78 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:52.658590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9ba682fb-7944-4168-ab19-40bf5ea77a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:52.770095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba682fb-7944-4168-ab19-40bf5ea77a78 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:52.778564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3bdab48838d4b81928d395160ab1d49', 'request_id': 'req-35c31467-99cb-4122-a141-9f17a01bdf5c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:52.800039 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3bdab48838d4b81928d395160ab1d49', 'request_id': 'req-35c31467-99cb-4122-a141-9f17a01bdf5c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:52.823737 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3bdab48838d4b81928d395160ab1d49', 'request_id': 'req-35c31467-99cb-4122-a141-9f17a01bdf5c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:52.864897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] The token cache is being invalidate because project d3bdab48838d4b81928d395160ab1d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:52.865922 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:52.869856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-35c31467-99cb-4122-a141-9f17a01bdf5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:52.878204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1192/2363] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:52 2021] DELETE /identity/v3/projects/d3bdab48838d4b81928d395160ab1d49 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:52.885092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d6f08-2620-4885-95fe-1dfa0744007a None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:52.885664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d6f08-2620-4885-95fe-1dfa0744007a None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:52.886202 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d6f08-2620-4885-95fe-1dfa0744007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:52.938664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32bf9e-c4af-4874-8fd8-e7e993f7bc63 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ddafedf2734326832ab4bf620f7634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:52.941993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32bf9e-c4af-4874-8fd8-e7e993f7bc63 service glance] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:52.943704 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32bf9e-c4af-4874-8fd8-e7e993f7bc63 service glance] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:52.945019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32bf9e-c4af-4874-8fd8-e7e993f7bc63 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:52.949976 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3a32bf9e-c4af-4874-8fd8-e7e993f7bc63 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:52.992083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5d0d6f08-2620-4885-95fe-1dfa0744007a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:53.003000 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5d0d6f08-2620-4885-95fe-1dfa0744007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:53.068624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32bf9e-c4af-4874-8fd8-e7e993f7bc63 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:53.071238 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32bf9e-c4af-4874-8fd8-e7e993f7bc63 service glance] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:53.088986 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1172/2364] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:53.252868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fab21-d4d1-4eb6-ab7f-4094ea1d0216 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:53.253505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fab21-d4d1-4eb6-ab7f-4094ea1d0216 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:53.253993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fab21-d4d1-4eb6-ab7f-4094ea1d0216 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:53.255966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1173/2365] 10.222.0.83 () {54 vars in 921 bytes} [Wed Dec 15 13:38:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:38:53.263141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b01cf-9f26-4594-9e8d-d335326d9e17 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:53.263980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b01cf-9f26-4594-9e8d-d335326d9e17 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:53.264287 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b01cf-9f26-4594-9e8d-d335326d9e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:53.269117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1193/2366] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:38:53.274346 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8b582-3396-4585-905b-772e4cc5a550 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:53.275651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8b582-3396-4585-905b-772e4cc5a550 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:53.276259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8b582-3396-4585-905b-772e4cc5a550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:53.290031 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-8d4b01cf-9f26-4594-9e8d-d335326d9e17 None None] MFA Rules not processed for user `de1632f6a5414d2abfdee3b5bdd941cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:53.292252 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8d4b01cf-9f26-4594-9e8d-d335326d9e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:53.314018 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-44c8b582-3396-4585-905b-772e4cc5a550 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:53.316376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-44c8b582-3396-4585-905b-772e4cc5a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:53.341892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1194/2367] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:53.346006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8b582-3396-4585-905b-772e4cc5a550 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:53.375429 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1174/2368] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Dec 15 13:38:53 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:53.375830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8b582-3396-4585-905b-772e4cc5a550 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:53.386652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac234d81-227e-4f65-8ea2-1ab2be017cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:53.387888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac234d81-227e-4f65-8ea2-1ab2be017cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:53.388458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac234d81-227e-4f65-8ea2-1ab2be017cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:53.389014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac234d81-227e-4f65-8ea2-1ab2be017cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:53.390522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac234d81-227e-4f65-8ea2-1ab2be017cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:38:53.390730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b01cf-9f26-4594-9e8d-d335326d9e17 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:53.391208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac234d81-227e-4f65-8ea2-1ab2be017cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:53.392473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8d4b01cf-9f26-4594-9e8d-d335326d9e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:53.394475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac234d81-227e-4f65-8ea2-1ab2be017cf1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:53.410740 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b01cf-9f26-4594-9e8d-d335326d9e17 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:53.423868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f401-1499-426f-9f83-1c22a6317bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:53.425248 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f401-1499-426f-9f83-1c22a6317bfe service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:53.425689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f401-1499-426f-9f83-1c22a6317bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:53.426159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f401-1499-426f-9f83-1c22a6317bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:53.435794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1195/2369] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:38:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:38:53.437695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac234d81-227e-4f65-8ea2-1ab2be017cf1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:53.447662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f401-1499-426f-9f83-1c22a6317bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:53.449195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f401-1499-426f-9f83-1c22a6317bfe service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:53.453906 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac234d81-227e-4f65-8ea2-1ab2be017cf1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:53.463308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab5593-d471-47d5-9cdf-9b26b26443a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:53.464025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1175/2370] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:53 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:38:53.474257 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab5593-d471-47d5-9cdf-9b26b26443a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:53.475843 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab5593-d471-47d5-9cdf-9b26b26443a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:53.476230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab5593-d471-47d5-9cdf-9b26b26443a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:53.477094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab5593-d471-47d5-9cdf-9b26b26443a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:53.480165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab5593-d471-47d5-9cdf-9b26b26443a8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:53.536436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1196/2371] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:53 2021] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:53.540546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f401-1499-426f-9f83-1c22a6317bfe service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:53.562084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f401-1499-426f-9f83-1c22a6317bfe service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:53.805477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee637f-fe48-44a1-bd87-01bcb279bbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:53.807612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee637f-fe48-44a1-bd87-01bcb279bbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:53.807906 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee637f-fe48-44a1-bd87-01bcb279bbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:53.808186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee637f-fe48-44a1-bd87-01bcb279bbe5 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:53.808959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee637f-fe48-44a1-bd87-01bcb279bbe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:53.828448 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee637f-fe48-44a1-bd87-01bcb279bbe5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:53.848076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334bdd8-607f-4df1-9a7a-421d7424b8a1 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:53.848532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334bdd8-607f-4df1-9a7a-421d7424b8a1 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:53.848824 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334bdd8-607f-4df1-9a7a-421d7424b8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:53.876107 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1176/2372] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:53 2021] POST /identity/v3/users => generated 286 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:38:53.880165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee637f-fe48-44a1-bd87-01bcb279bbe5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:53.891064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee637f-fe48-44a1-bd87-01bcb279bbe5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:53.895463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-9334bdd8-607f-4df1-9a7a-421d7424b8a1 None None] MFA Rules not processed for user `8fa045c5aa324b8a8e3f3d83437c706d`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:53.896676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9334bdd8-607f-4df1-9a7a-421d7424b8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:53.899026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9414-118c-45ff-9bdf-a00a65f2d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:53.900339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9414-118c-45ff-9bdf-a00a65f2d9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:53.900812 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9414-118c-45ff-9bdf-a00a65f2d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:53.901329 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9414-118c-45ff-9bdf-a00a65f2d9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:53.902818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb9414-118c-45ff-9bdf-a00a65f2d9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:53.906083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb9414-118c-45ff-9bdf-a00a65f2d9c1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:53.925178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1177/2373] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:53 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:38:53.928931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9414-118c-45ff-9bdf-a00a65f2d9c1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:53.942404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9414-118c-45ff-9bdf-a00a65f2d9c1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:53.949096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d82c7b-e939-453a-9bb6-714434218bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:53.950035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d82c7b-e939-453a-9bb6-714434218bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:53.950480 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d82c7b-e939-453a-9bb6-714434218bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:53.950903 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d82c7b-e939-453a-9bb6-714434218bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:53.951931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d82c7b-e939-453a-9bb6-714434218bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:53.954795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d82c7b-e939-453a-9bb6-714434218bfc admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:53.967631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1178/2374] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:53 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:38:53.971946 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d82c7b-e939-453a-9bb6-714434218bfc admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:53.985022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d82c7b-e939-453a-9bb6-714434218bfc admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:53.993281 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42224d1-ea57-4f5c-b8d2-c2ad8df9e561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:53.994918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42224d1-ea57-4f5c-b8d2-c2ad8df9e561 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:53.995202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42224d1-ea57-4f5c-b8d2-c2ad8df9e561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:53.995474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42224d1-ea57-4f5c-b8d2-c2ad8df9e561 admin admin] PATH_INFO: `/v3/projects/b31e79a4da1145889a3c3b089d3eb2c3/users/24833c8ad7c04edf8008756e62d39e82/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.025164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1197/2375] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:53 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:54.026543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334bdd8-607f-4df1-9a7a-421d7424b8a1 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:54.031716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9334bdd8-607f-4df1-9a7a-421d7424b8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:54.071384 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334bdd8-607f-4df1-9a7a-421d7424b8a1 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:54.073520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42224d1-ea57-4f5c-b8d2-c2ad8df9e561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31e79a4da1145889a3c3b089d3eb2c3, user_id=24833c8ad7c04edf8008756e62d39e82, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:54.083288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799092e-7ef7-4d21-a11a-575f2fac3f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:54.084271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42224d1-ea57-4f5c-b8d2-c2ad8df9e561 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:54.084548 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799092e-7ef7-4d21-a11a-575f2fac3f0d admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:54.085078 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799092e-7ef7-4d21-a11a-575f2fac3f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:54.085617 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799092e-7ef7-4d21-a11a-575f2fac3f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.086780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799092e-7ef7-4d21-a11a-575f2fac3f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:54.092095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799092e-7ef7-4d21-a11a-575f2fac3f0d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:54.120900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1179/2376] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:53 2021] PUT /identity/v3/projects/b31e79a4da1145889a3c3b089d3eb2c3/users/24833c8ad7c04edf8008756e62d39e82/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:54.122750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5428df-c03e-4f1f-b836-1792d207010f None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:54.123198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5428df-c03e-4f1f-b836-1792d207010f None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:54.123629 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5428df-c03e-4f1f-b836-1792d207010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.161478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1198/2377] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:54 2021] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:54.164594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799092e-7ef7-4d21-a11a-575f2fac3f0d admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:54.164813 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-1e5428df-c03e-4f1f-b836-1792d207010f None None] MFA Rules not processed for user `24833c8ad7c04edf8008756e62d39e82`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:54.166910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1e5428df-c03e-4f1f-b836-1792d207010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:54.285428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1180/2378] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:54 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:54.295413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799092e-7ef7-4d21-a11a-575f2fac3f0d admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:54.300797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd31a4c-b17a-4f16-b1d4-749371d436be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:54.301482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31a4c-b17a-4f16-b1d4-749371d436be admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:54.301781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31a4c-b17a-4f16-b1d4-749371d436be admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:54.302103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31a4c-b17a-4f16-b1d4-749371d436be admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.302882 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd31a4c-b17a-4f16-b1d4-749371d436be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:54.304780 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd31a4c-b17a-4f16-b1d4-749371d436be admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:54.312553 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5428df-c03e-4f1f-b836-1792d207010f None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:54.317235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1e5428df-c03e-4f1f-b836-1792d207010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:54.328099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1199/2379] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:54 2021] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:54.331983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd31a4c-b17a-4f16-b1d4-749371d436be admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:54.342847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd31a4c-b17a-4f16-b1d4-749371d436be admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:54.349194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01811c33-a3de-408d-8000-ca66cdc21f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:54.350611 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811c33-a3de-408d-8000-ca66cdc21f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:54.351089 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811c33-a3de-408d-8000-ca66cdc21f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:54.351549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811c33-a3de-408d-8000-ca66cdc21f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.352550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01811c33-a3de-408d-8000-ca66cdc21f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:54.360908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01811c33-a3de-408d-8000-ca66cdc21f67 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:54.372637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1200/2380] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:54 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:54.377652 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01811c33-a3de-408d-8000-ca66cdc21f67 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:54.389358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01811c33-a3de-408d-8000-ca66cdc21f67 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:54.394293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487c6fb-e12b-4122-b0db-1c017ae643da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:54.395315 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487c6fb-e12b-4122-b0db-1c017ae643da admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:54.395889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487c6fb-e12b-4122-b0db-1c017ae643da admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:54.395889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487c6fb-e12b-4122-b0db-1c017ae643da admin admin] PATH_INFO: `/v3/projects/ec67a4206df348848fed725e5e1049ee/users/9886f0663f6645aeade86ec151fe7d7f/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.397218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5428df-c03e-4f1f-b836-1792d207010f None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:54.401311 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06134c55-9764-42ed-9629-375acfafb534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:54.401968 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134c55-9764-42ed-9629-375acfafb534 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:54.402248 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134c55-9764-42ed-9629-375acfafb534 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:54.402518 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134c55-9764-42ed-9629-375acfafb534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.411040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06134c55-9764-42ed-9629-375acfafb534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:54.412468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06134c55-9764-42ed-9629-375acfafb534 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:54.413020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487c6fb-e12b-4122-b0db-1c017ae643da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec67a4206df348848fed725e5e1049ee, user_id=9886f0663f6645aeade86ec151fe7d7f, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:54.416388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487c6fb-e12b-4122-b0db-1c017ae643da admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:54.422518 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1181/2381] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:54 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:38:54.432675 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1201/2382] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:54 2021] PUT /identity/v3/projects/ec67a4206df348848fed725e5e1049ee/users/9886f0663f6645aeade86ec151fe7d7f/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:54.436838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06134c55-9764-42ed-9629-375acfafb534 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:54.450156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06134c55-9764-42ed-9629-375acfafb534 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:54.450830 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487c6fb-e12b-4122-b0db-1c017ae643da admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:54.512949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad53ff-d6f5-40a2-8590-5066a42dd292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:54.513621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad53ff-d6f5-40a2-8590-5066a42dd292 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:54.513939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad53ff-d6f5-40a2-8590-5066a42dd292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:54.514211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad53ff-d6f5-40a2-8590-5066a42dd292 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.514955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad53ff-d6f5-40a2-8590-5066a42dd292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:54.516554 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad53ff-d6f5-40a2-8590-5066a42dd292 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:54.520415 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487c6fb-e12b-4122-b0db-1c017ae643da admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:54.527503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:54.528040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1182/2383] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:54 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:38:54.528583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:54.528879 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:54.529155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] PATH_INFO: `/v3/users/24833c8ad7c04edf8008756e62d39e82` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.531285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=24833c8ad7c04edf8008756e62d39e82)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:54.531949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad53ff-d6f5-40a2-8590-5066a42dd292 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:54.532505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:54.545914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad53ff-d6f5-40a2-8590-5066a42dd292 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:54.550848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5180e8-0ac9-4848-beb8-422db1872eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:54.551744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5180e8-0ac9-4848-beb8-422db1872eae admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:54.552022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5180e8-0ac9-4848-beb8-422db1872eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:54.552293 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5180e8-0ac9-4848-beb8-422db1872eae admin admin] PATH_INFO: `/v3/projects/ec67a4206df348848fed725e5e1049ee/users/9886f0663f6645aeade86ec151fe7d7f/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.554342 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5180e8-0ac9-4848-beb8-422db1872eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec67a4206df348848fed725e5e1049ee, user_id=9886f0663f6645aeade86ec151fe7d7f, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:54.557022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5180e8-0ac9-4848-beb8-422db1872eae admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:54.568631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1183/2384] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:54 2021] PUT /identity/v3/projects/ec67a4206df348848fed725e5e1049ee/users/9886f0663f6645aeade86ec151fe7d7f/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:38:54.587135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24833c8ad7c04edf8008756e62d39e82'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:54.596757 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24833c8ad7c04edf8008756e62d39e82'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:54.597529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24833c8ad7c04edf8008756e62d39e82'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:54.612160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24833c8ad7c04edf8008756e62d39e82'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:54.612903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24833c8ad7c04edf8008756e62d39e82'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:54.630731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1202/2385] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:54 2021] DELETE /identity/v3/users/24833c8ad7c04edf8008756e62d39e82 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:54.636009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479753-afc2-4855-98cf-dafa754b54d3 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:54.636328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479753-afc2-4855-98cf-dafa754b54d3 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:54.636624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479753-afc2-4855-98cf-dafa754b54d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.667303 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-60479753-afc2-4855-98cf-dafa754b54d3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:54.668882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-60479753-afc2-4855-98cf-dafa754b54d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:54.761712 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1184/2386] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:54.771792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:54.773461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:54.845879 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d3b9b-08dc-4ce2-b50e-831a1bd3e23c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:54.849568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea6d8d-6d91-43e3-9a01-3e077765116c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:54.850265 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6d8d-6d91-43e3-9a01-3e077765116c service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:54.850545 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6d8d-6d91-43e3-9a01-3e077765116c service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:54.850820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6d8d-6d91-43e3-9a01-3e077765116c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:54.862896 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea6d8d-6d91-43e3-9a01-3e077765116c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:54.863970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea6d8d-6d91-43e3-9a01-3e077765116c service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:54.876945 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1203/2387] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:55.204546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60479753-afc2-4855-98cf-dafa754b54d3 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:55.205935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-60479753-afc2-4855-98cf-dafa754b54d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:55.248122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60479753-afc2-4855-98cf-dafa754b54d3 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:55.265054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:55.266132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:55.266520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:55.267167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] PATH_INFO: `/v3/projects/b31e79a4da1145889a3c3b089d3eb2c3` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:55.269257 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31e79a4da1145889a3c3b089d3eb2c3)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:55.272381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:55.370176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31e79a4da1145889a3c3b089d3eb2c3', 'request_id': 'req-28303048-6c5c-4f82-8958-6914bf0144e9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:55.379570 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31e79a4da1145889a3c3b089d3eb2c3', 'request_id': 'req-28303048-6c5c-4f82-8958-6914bf0144e9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:55.392672 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31e79a4da1145889a3c3b089d3eb2c3', 'request_id': 'req-28303048-6c5c-4f82-8958-6914bf0144e9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:55.409801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] The token cache is being invalidate because project b31e79a4da1145889a3c3b089d3eb2c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:38:55.410199 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:55.411396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-28303048-6c5c-4f82-8958-6914bf0144e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:55.416019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1185/2388] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:38:55 2021] DELETE /identity/v3/projects/b31e79a4da1145889a3c3b089d3eb2c3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:55.419918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f37d8a-27bf-46ba-b797-c88d36fa1b77 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:55.420472 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f37d8a-27bf-46ba-b797-c88d36fa1b77 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:55.421132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f37d8a-27bf-46ba-b797-c88d36fa1b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:55.463580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-74f37d8a-27bf-46ba-b797-c88d36fa1b77 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:55.464969 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-74f37d8a-27bf-46ba-b797-c88d36fa1b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:55.584298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1204/2389] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:55.594023 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d047e-68f0-4204-8c67-818c9348c253 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:55.594929 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d047e-68f0-4204-8c67-818c9348c253 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:55.595379 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d047e-68f0-4204-8c67-818c9348c253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:55.632113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f55d047e-68f0-4204-8c67-818c9348c253 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:55.634729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f55d047e-68f0-4204-8c67-818c9348c253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:55.646727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1186/2390] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:55.647768 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f37d8a-27bf-46ba-b797-c88d36fa1b77 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:55.664363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f37d8a-27bf-46ba-b797-c88d36fa1b77 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:55.670413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d9614-44e0-4ef6-9091-4da18b64de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:55.671543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d9614-44e0-4ef6-9091-4da18b64de43 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:55.671829 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d9614-44e0-4ef6-9091-4da18b64de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:55.672141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d9614-44e0-4ef6-9091-4da18b64de43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:55.673143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d9614-44e0-4ef6-9091-4da18b64de43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:38:55.673730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d9614-44e0-4ef6-9091-4da18b64de43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:55.675619 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d9614-44e0-4ef6-9091-4da18b64de43 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:55.694501 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1205/2391] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:38:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:38:55.695858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d047e-68f0-4204-8c67-818c9348c253 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:55.713055 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d047e-68f0-4204-8c67-818c9348c253 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:55.718157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e3823-dfc7-468f-a60c-d96c50be1b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:55.718828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e3823-dfc7-468f-a60c-d96c50be1b6e admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:55.719108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e3823-dfc7-468f-a60c-d96c50be1b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:55.719531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e3823-dfc7-468f-a60c-d96c50be1b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:55.720257 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e3823-dfc7-468f-a60c-d96c50be1b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:55.722877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e3823-dfc7-468f-a60c-d96c50be1b6e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:55.763988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d9614-44e0-4ef6-9091-4da18b64de43 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:55.764389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1187/2392] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:38:55 2021] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:38:55.778627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d9614-44e0-4ef6-9091-4da18b64de43 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:55.912868 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b9f96-a185-4c6d-8040-29b9c9a7d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:55.913921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9f96-a185-4c6d-8040-29b9c9a7d2ba admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:55.914445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9f96-a185-4c6d-8040-29b9c9a7d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:55.914948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9f96-a185-4c6d-8040-29b9c9a7d2ba admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:55.915804 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b9f96-a185-4c6d-8040-29b9c9a7d2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:55.917829 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b9f96-a185-4c6d-8040-29b9c9a7d2ba admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:55.954850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1206/2393] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:38:55 2021] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:38:55.958874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e3823-dfc7-468f-a60c-d96c50be1b6e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:55.970261 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e3823-dfc7-468f-a60c-d96c50be1b6e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:55.975566 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c116d-2d4f-4d6b-aa45-ba2593967c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:55.976274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c116d-2d4f-4d6b-aa45-ba2593967c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:55.976841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c116d-2d4f-4d6b-aa45-ba2593967c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:55.977077 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c116d-2d4f-4d6b-aa45-ba2593967c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:55.977903 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c116d-2d4f-4d6b-aa45-ba2593967c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:55.979530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c116d-2d4f-4d6b-aa45-ba2593967c44 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:55.991039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1188/2394] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:38:55.995722 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b9f96-a185-4c6d-8040-29b9c9a7d2ba admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:56.006365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b9f96-a185-4c6d-8040-29b9c9a7d2ba admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:56.014908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820f839-3434-411b-9509-1df4ceea1bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:56.015582 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f839-3434-411b-9509-1df4ceea1bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:56.015870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f839-3434-411b-9509-1df4ceea1bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:56.016129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f839-3434-411b-9509-1df4ceea1bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:56.016872 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820f839-3434-411b-9509-1df4ceea1bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:56.018480 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820f839-3434-411b-9509-1df4ceea1bd8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:56.028817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1207/2395] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:38:55 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:38:56.033029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c116d-2d4f-4d6b-aa45-ba2593967c44 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:56.044146 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c116d-2d4f-4d6b-aa45-ba2593967c44 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:56.049059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16682270-aac9-43b8-940e-ad56b2290984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:56.049987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16682270-aac9-43b8-940e-ad56b2290984 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:56.050269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16682270-aac9-43b8-940e-ad56b2290984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:56.050546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16682270-aac9-43b8-940e-ad56b2290984 admin admin] PATH_INFO: `/v3/projects/3b040f42f67e4061b728e00adb165e5d/users/bd856659215346d39dedfdb6648f90e8/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:56.068882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16682270-aac9-43b8-940e-ad56b2290984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b040f42f67e4061b728e00adb165e5d, user_id=bd856659215346d39dedfdb6648f90e8, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:56.073026 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16682270-aac9-43b8-940e-ad56b2290984 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:56.088481 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1189/2396] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:38:56 2021] PUT /identity/v3/projects/3b040f42f67e4061b728e00adb165e5d/users/bd856659215346d39dedfdb6648f90e8/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:56.099409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf71a-cc02-4af8-96f1-754c3a394647 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:56.099734 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf71a-cc02-4af8-96f1-754c3a394647 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:56.099971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf71a-cc02-4af8-96f1-754c3a394647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:56.142130 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8f0bf71a-cc02-4af8-96f1-754c3a394647 None None] MFA Rules not processed for user `bd856659215346d39dedfdb6648f90e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:56.143382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8f0bf71a-cc02-4af8-96f1-754c3a394647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:56.223607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1208/2397] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:56 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:56.232698 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16682270-aac9-43b8-940e-ad56b2290984 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:56.234608 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-16682270-aac9-43b8-940e-ad56b2290984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:56.299862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16682270-aac9-43b8-940e-ad56b2290984 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:56.304008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698eca-5d48-49f7-8b97-3c83240779b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:56.304655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698eca-5d48-49f7-8b97-3c83240779b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:56.304937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698eca-5d48-49f7-8b97-3c83240779b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:56.305211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698eca-5d48-49f7-8b97-3c83240779b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:56.315096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8698eca-5d48-49f7-8b97-3c83240779b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:56.316525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8698eca-5d48-49f7-8b97-3c83240779b9 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:56.330587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1190/2398] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:56 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:38:57.640885 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9f0e-3199-4cad-bb03-567d1e0ddb41 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:57.641456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9f0e-3199-4cad-bb03-567d1e0ddb41 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:57.641456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9f0e-3199-4cad-bb03-567d1e0ddb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:57.670534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-167a9f0e-3199-4cad-bb03-567d1e0ddb41 None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:57.671904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-167a9f0e-3199-4cad-bb03-567d1e0ddb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:57.843114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1209/2399] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:38:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:57.860863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698eca-5d48-49f7-8b97-3c83240779b9 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:57.864417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b8698eca-5d48-49f7-8b97-3c83240779b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:57.935836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f941-d18f-4a4c-842d-62d369782156 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:57.937029 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f941-d18f-4a4c-842d-62d369782156 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:57.937474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f941-d18f-4a4c-842d-62d369782156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:57.960860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-6a15f941-d18f-4a4c-842d-62d369782156 None None] MFA Rules not processed for user `bd856659215346d39dedfdb6648f90e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:57.970342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6a15f941-d18f-4a4c-842d-62d369782156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:57.991095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1210/2400] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:57 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:58.062466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698eca-5d48-49f7-8b97-3c83240779b9 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:58.080060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77677df1-e09b-47b5-ae06-58e1a34ec9a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:58.080848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77677df1-e09b-47b5-ae06-58e1a34ec9a5 service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:58.081299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77677df1-e09b-47b5-ae06-58e1a34ec9a5 service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:58.081741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77677df1-e09b-47b5-ae06-58e1a34ec9a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:58.107952 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77677df1-e09b-47b5-ae06-58e1a34ec9a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:58.124741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77677df1-e09b-47b5-ae06-58e1a34ec9a5 service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:58.161822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1191/2401] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:38:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:38:58.415792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15f941-d18f-4a4c-842d-62d369782156 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:58.417813 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6a15f941-d18f-4a4c-842d-62d369782156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:58.619657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15f941-d18f-4a4c-842d-62d369782156 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:58.637083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:58.645917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:58.646902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:58.647339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] PATH_INFO: `/v3/users/a52c574944424785bcbda90bf6b71f1a` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:58.658227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52c574944424785bcbda90bf6b71f1a)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:58.660704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:58.735349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52c574944424785bcbda90bf6b71f1a'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:58.756706 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52c574944424785bcbda90bf6b71f1a'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:58.757731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52c574944424785bcbda90bf6b71f1a'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:58.819385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52c574944424785bcbda90bf6b71f1a'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:58.822489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52c574944424785bcbda90bf6b71f1a'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:38:58.853850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1211/2402] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:38:58 2021] DELETE /identity/v3/users/a52c574944424785bcbda90bf6b71f1a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:38:58.859166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5c74c-97ec-4c50-b546-7f13ecdb3f4c None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:58.859683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5c74c-97ec-4c50-b546-7f13ecdb3f4c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:58.860017 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5c74c-97ec-4c50-b546-7f13ecdb3f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:58.922122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-13e5c74c-97ec-4c50-b546-7f13ecdb3f4c None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:38:58.924650 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-13e5c74c-97ec-4c50-b546-7f13ecdb3f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:59.187825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1192/2403] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:38:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:38:59.271217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:38:59.274806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:38:59.469852 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d387bf4-472c-430f-bccf-22937e6ce4a2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:38:59.481914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2b859-26ee-4db2-87e9-24b6e51f067e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:38:59.482622 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2b859-26ee-4db2-87e9-24b6e51f067e service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:38:59.482902 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2b859-26ee-4db2-87e9-24b6e51f067e service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:38:59.483280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2b859-26ee-4db2-87e9-24b6e51f067e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:38:59.513421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2b859-26ee-4db2-87e9-24b6e51f067e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:38:59.515392 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2b859-26ee-4db2-87e9-24b6e51f067e service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:38:59.540165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1212/2404] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:38:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:39:00.974545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5c74c-97ec-4c50-b546-7f13ecdb3f4c None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:00.977444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-13e5c74c-97ec-4c50-b546-7f13ecdb3f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:01.013965 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5c74c-97ec-4c50-b546-7f13ecdb3f4c None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:01.030820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:01.034556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:01.034867 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:01.035230 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] PATH_INFO: `/v3/projects/b3668af6214f497dbc0c3367ab543301` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:01.038584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3668af6214f497dbc0c3367ab543301)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:01.048452 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:01.176811 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3668af6214f497dbc0c3367ab543301', 'request_id': 'req-18047aac-8303-48da-9769-471542d14fb4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:01.189394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3668af6214f497dbc0c3367ab543301', 'request_id': 'req-18047aac-8303-48da-9769-471542d14fb4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:01.209826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3668af6214f497dbc0c3367ab543301', 'request_id': 'req-18047aac-8303-48da-9769-471542d14fb4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:01.264519 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] The token cache is being invalidate because project b3668af6214f497dbc0c3367ab543301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:39:01.267115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:01.269773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-18047aac-8303-48da-9769-471542d14fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:01.273561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1193/2405] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:39:00 2021] DELETE /identity/v3/projects/b3668af6214f497dbc0c3367ab543301 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:01.279818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cadeb6-b78d-4335-9b56-a3260e1a7ce8 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:01.280345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cadeb6-b78d-4335-9b56-a3260e1a7ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:01.280438 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cadeb6-b78d-4335-9b56-a3260e1a7ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:01.320916 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f170-d70e-4731-b20a-a309be37dca7 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:01.321365 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f170-d70e-4731-b20a-a309be37dca7 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:01.321872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f170-d70e-4731-b20a-a309be37dca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:01.357020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d7cadeb6-b78d-4335-9b56-a3260e1a7ce8 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:01.361678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d7cadeb6-b78d-4335-9b56-a3260e1a7ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:01.361865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d270f170-d70e-4731-b20a-a309be37dca7 None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:01.365317 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d270f170-d70e-4731-b20a-a309be37dca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:01.503113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1194/2406] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:39:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Dec 15 13:39:01.527919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270f170-d70e-4731-b20a-a309be37dca7 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:01.529479 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d270f170-d70e-4731-b20a-a309be37dca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:01.555647 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1213/2407] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:01.562445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fa2a6-bf22-4574-a975-5f12e736b2be None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:01.565413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fa2a6-bf22-4574-a975-5f12e736b2be None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:01.565910 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fa2a6-bf22-4574-a975-5f12e736b2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:01.614383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8e4fa2a6-bf22-4574-a975-5f12e736b2be None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:01.619289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8e4fa2a6-bf22-4574-a975-5f12e736b2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:01.657593 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1214/2408] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:01.659485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fa2a6-bf22-4574-a975-5f12e736b2be None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:01.686288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fa2a6-bf22-4574-a975-5f12e736b2be None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:01.700309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f502c-a865-4555-9976-4c0829fa61c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:01.702896 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f502c-a865-4555-9976-4c0829fa61c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:01.703449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f502c-a865-4555-9976-4c0829fa61c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:01.706128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f502c-a865-4555-9976-4c0829fa61c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:01.707201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f502c-a865-4555-9976-4c0829fa61c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:39:01.707513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f502c-a865-4555-9976-4c0829fa61c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:01.713344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f502c-a865-4555-9976-4c0829fa61c4 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:01.748907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270f170-d70e-4731-b20a-a309be37dca7 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:01.756525 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1215/2409] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:39:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:39:01.765284 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f502c-a865-4555-9976-4c0829fa61c4 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:01.770218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f049c2-1cc9-4322-8979-4a33de8b2bab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:01.770955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f049c2-1cc9-4322-8979-4a33de8b2bab service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:01.771266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f049c2-1cc9-4322-8979-4a33de8b2bab service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:01.771544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f049c2-1cc9-4322-8979-4a33de8b2bab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:01.793727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f049c2-1cc9-4322-8979-4a33de8b2bab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:01.796388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f502c-a865-4555-9976-4c0829fa61c4 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:01.797658 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f049c2-1cc9-4322-8979-4a33de8b2bab service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:01.809702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19c386-26b4-45d7-b311-4d07a455ccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:01.811738 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c386-26b4-45d7-b311-4d07a455ccfa admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:01.814727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c386-26b4-45d7-b311-4d07a455ccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:01.816679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c386-26b4-45d7-b311-4d07a455ccfa admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:01.818700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19c386-26b4-45d7-b311-4d07a455ccfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:01.824788 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19c386-26b4-45d7-b311-4d07a455ccfa admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:01.826209 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1195/2410] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:39:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:39:01.878799 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f049c2-1cc9-4322-8979-4a33de8b2bab service swift] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:01.879203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1216/2411] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:39:01 2021] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:39:01.897737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f049c2-1cc9-4322-8979-4a33de8b2bab service swift] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:02.121382 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2915e6c-cac9-41ac-a99c-8ae4eac1a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:02.122159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2915e6c-cac9-41ac-a99c-8ae4eac1a148 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:02.122406 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2915e6c-cac9-41ac-a99c-8ae4eac1a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:02.122773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2915e6c-cac9-41ac-a99c-8ae4eac1a148 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:02.123487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2915e6c-cac9-41ac-a99c-8ae4eac1a148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:02.125519 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2915e6c-cac9-41ac-a99c-8ae4eac1a148 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:02.177335 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1196/2412] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:39:01 2021] POST /identity/v3/users => generated 284 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:39:02.182427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19c386-26b4-45d7-b311-4d07a455ccfa admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:02.208929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19c386-26b4-45d7-b311-4d07a455ccfa admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:02.225201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7e6a-78c2-4342-b5bd-9ac47897412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:02.229064 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7e6a-78c2-4342-b5bd-9ac47897412b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:02.229391 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7e6a-78c2-4342-b5bd-9ac47897412b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:02.230410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7e6a-78c2-4342-b5bd-9ac47897412b admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:02.231200 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7e6a-78c2-4342-b5bd-9ac47897412b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:02.241567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7e6a-78c2-4342-b5bd-9ac47897412b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:02.270188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1217/2413] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:39:02 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:39:02.274210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2915e6c-cac9-41ac-a99c-8ae4eac1a148 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:02.291007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2915e6c-cac9-41ac-a99c-8ae4eac1a148 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:02.309190 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c06887-040a-42ea-a9ca-07e95e0c47f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:02.310360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c06887-040a-42ea-a9ca-07e95e0c47f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:02.310642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c06887-040a-42ea-a9ca-07e95e0c47f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:02.310918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c06887-040a-42ea-a9ca-07e95e0c47f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:02.312807 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c06887-040a-42ea-a9ca-07e95e0c47f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:02.316998 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c06887-040a-42ea-a9ca-07e95e0c47f7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:02.352738 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1197/2414] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:39:02 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:39:02.361323 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7e6a-78c2-4342-b5bd-9ac47897412b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:02.386453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7e6a-78c2-4342-b5bd-9ac47897412b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:02.399107 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22c260-cb97-4afd-a1ae-947a8f531da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:02.400195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c260-cb97-4afd-a1ae-947a8f531da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:02.401664 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c260-cb97-4afd-a1ae-947a8f531da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:02.404471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c260-cb97-4afd-a1ae-947a8f531da8 admin admin] PATH_INFO: `/v3/projects/0693149e3ea245fdaea28d9e18cd886d/users/457424d49d4a41b383fe3d387b763d5d/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:02.450601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22c260-cb97-4afd-a1ae-947a8f531da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0693149e3ea245fdaea28d9e18cd886d, user_id=457424d49d4a41b383fe3d387b763d5d, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:02.460611 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22c260-cb97-4afd-a1ae-947a8f531da8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:02.495377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1218/2415] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:39:02 2021] PUT /identity/v3/projects/0693149e3ea245fdaea28d9e18cd886d/users/457424d49d4a41b383fe3d387b763d5d/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:02.506911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228a9b-3efb-4c34-8549-c120f2c9b323 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:02.507860 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228a9b-3efb-4c34-8549-c120f2c9b323 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:02.508153 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228a9b-3efb-4c34-8549-c120f2c9b323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:02.566552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-70228a9b-3efb-4c34-8549-c120f2c9b323 None None] MFA Rules not processed for user `457424d49d4a41b383fe3d387b763d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:02.570465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-70228a9b-3efb-4c34-8549-c120f2c9b323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:02.765188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1198/2416] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:02 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:05.812594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ef43-1ed4-4261-9eaf-fc7fe2bdb00b None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:05.813193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ef43-1ed4-4261-9eaf-fc7fe2bdb00b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:05.813193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ef43-1ed4-4261-9eaf-fc7fe2bdb00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:05.921250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-1e49ef43-1ed4-4261-9eaf-fc7fe2bdb00b None None] MFA Rules not processed for user `9886f0663f6645aeade86ec151fe7d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:05.924081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1e49ef43-1ed4-4261-9eaf-fc7fe2bdb00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:06.117790 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70228a9b-3efb-4c34-8549-c120f2c9b323 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:06.120595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-70228a9b-3efb-4c34-8549-c120f2c9b323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:06.188943 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1219/2417] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:05 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:06.201066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49ef43-1ed4-4261-9eaf-fc7fe2bdb00b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:06.202998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1e49ef43-1ed4-4261-9eaf-fc7fe2bdb00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:06.454980 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70228a9b-3efb-4c34-8549-c120f2c9b323 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:06.456957 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49ef43-1ed4-4261-9eaf-fc7fe2bdb00b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:06.471355 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf997c-50dd-4711-b52a-948019eb6a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:06.473804 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf997c-50dd-4711-b52a-948019eb6a92 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:06.475789 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf997c-50dd-4711-b52a-948019eb6a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:06.477432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf997c-50dd-4711-b52a-948019eb6a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:06.485818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fdcf997c-50dd-4711-b52a-948019eb6a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:06.486712 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af17d58-f3c2-48d9-9e25-1ce57c2c3866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:06.487616 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af17d58-f3c2-48d9-9e25-1ce57c2c3866 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:06.487885 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af17d58-f3c2-48d9-9e25-1ce57c2c3866 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:06.488266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af17d58-f3c2-48d9-9e25-1ce57c2c3866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:06.495601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9af17d58-f3c2-48d9-9e25-1ce57c2c3866 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:06.676779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af17d58-f3c2-48d9-9e25-1ce57c2c3866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:06.678628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af17d58-f3c2-48d9-9e25-1ce57c2c3866 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:06.683141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf997c-50dd-4711-b52a-948019eb6a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:06.688986 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf997c-50dd-4711-b52a-948019eb6a92 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:06.706509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1220/2418] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:39:06 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:39:06.716698 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1199/2419] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:39:06 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:39:12.564963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0402c-ee1c-44a6-8449-0519a09d436b None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:12.565593 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0402c-ee1c-44a6-8449-0519a09d436b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:12.566125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0402c-ee1c-44a6-8449-0519a09d436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:12.638600 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5df0402c-ee1c-44a6-8449-0519a09d436b None None] MFA Rules not processed for user `8fa045c5aa324b8a8e3f3d83437c706d`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:12.641120 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5df0402c-ee1c-44a6-8449-0519a09d436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:12.663764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1221/2420] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:12 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:18.595717 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf997c-50dd-4711-b52a-948019eb6a92 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:18.597885 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fdcf997c-50dd-4711-b52a-948019eb6a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:18.681517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf997c-50dd-4711-b52a-948019eb6a92 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:18.688930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b654b07-8ac1-48e2-a873-16b5ac40be43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ddafedf2734326832ab4bf620f7634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:18.691312 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b654b07-8ac1-48e2-a873-16b5ac40be43 service glance] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:18.692127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b654b07-8ac1-48e2-a873-16b5ac40be43 service glance] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:18.692919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b654b07-8ac1-48e2-a873-16b5ac40be43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:18.708875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b654b07-8ac1-48e2-a873-16b5ac40be43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:18.711972 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b654b07-8ac1-48e2-a873-16b5ac40be43 service glance] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:18.730794 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1200/2421] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:39:18 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:39:39.245811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532b61d-9fc1-4e0b-bb1c-9c239895c1ac None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:39.246377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532b61d-9fc1-4e0b-bb1c-9c239895c1ac None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:39.246470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532b61d-9fc1-4e0b-bb1c-9c239895c1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:39.277555 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-7532b61d-9fc1-4e0b-bb1c-9c239895c1ac None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:39.278847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7532b61d-9fc1-4e0b-bb1c-9c239895c1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:39.342729 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1222/2422] 10.222.0.83 () {58 vars in 967 bytes} [Wed Dec 15 13:39:39 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:39.366723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b654b07-8ac1-48e2-a873-16b5ac40be43 service glance] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:39.444687 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b654b07-8ac1-48e2-a873-16b5ac40be43 service glance] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:39.450454 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c68b-43f4-4a09-871a-ed72faf55eb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:39.451106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c68b-43f4-4a09-871a-ed72faf55eb8 service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:39.451388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c68b-43f4-4a09-871a-ed72faf55eb8 service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:39.451664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c68b-43f4-4a09-871a-ed72faf55eb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:39.461800 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261c68b-43f4-4a09-871a-ed72faf55eb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:39.463468 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261c68b-43f4-4a09-871a-ed72faf55eb8 service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:39.471960 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1201/2423] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:39:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:39:39.982537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9232404-39b8-4acd-9a4a-457abf6c6489 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:39.982829 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9232404-39b8-4acd-9a4a-457abf6c6489 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:39.983107 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9232404-39b8-4acd-9a4a-457abf6c6489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:40.002215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e9232404-39b8-4acd-9a4a-457abf6c6489 None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:40.003424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e9232404-39b8-4acd-9a4a-457abf6c6489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:40.011478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1223/2424] 10.222.0.83 () {58 vars in 967 bytes} [Wed Dec 15 13:39:39 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:40.027038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c68b-43f4-4a09-871a-ed72faf55eb8 service swift] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:40.038563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c68b-43f4-4a09-871a-ed72faf55eb8 service swift] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:40.045054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b5da7-21af-417d-8498-323960898220 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:40.045855 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b5da7-21af-417d-8498-323960898220 service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:40.051338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b5da7-21af-417d-8498-323960898220 service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:40.051338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b5da7-21af-417d-8498-323960898220 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:40.060985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b5da7-21af-417d-8498-323960898220 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:40.066245 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b5da7-21af-417d-8498-323960898220 service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:40.074198 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1202/2425] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:39:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:39:40.431489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff3fc-a069-4a91-8a06-25b31b9ecd40 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:40.431970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff3fc-a069-4a91-8a06-25b31b9ecd40 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:40.432132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff3fc-a069-4a91-8a06-25b31b9ecd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:40.453660 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-3adff3fc-a069-4a91-8a06-25b31b9ecd40 None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:40.455460 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3adff3fc-a069-4a91-8a06-25b31b9ecd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:40.465590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1224/2426] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:39:40 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:40.482951 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b5da7-21af-417d-8498-323960898220 service swift] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:40.493076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b5da7-21af-417d-8498-323960898220 service swift] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:40.499133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f9741-ab9d-4e0b-8f9f-95c4932b8564 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:40.499994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9741-ab9d-4e0b-8f9f-95c4932b8564 service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:40.500272 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9741-ab9d-4e0b-8f9f-95c4932b8564 service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:40.500546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9741-ab9d-4e0b-8f9f-95c4932b8564 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:40.508453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f9741-ab9d-4e0b-8f9f-95c4932b8564 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:40.510570 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f9741-ab9d-4e0b-8f9f-95c4932b8564 service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:40.518530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1203/2427] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:39:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:39:41.073937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209fbd4-11f3-4558-8feb-8e66e87e63ee None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:41.074336 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209fbd4-11f3-4558-8feb-8e66e87e63ee None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:41.074628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209fbd4-11f3-4558-8feb-8e66e87e63ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:41.093084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-1209fbd4-11f3-4558-8feb-8e66e87e63ee None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:41.094338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1209fbd4-11f3-4558-8feb-8e66e87e63ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:41.104263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1225/2428] 10.222.0.83 () {58 vars in 967 bytes} [Wed Dec 15 13:39:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:41.119005 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f9741-ab9d-4e0b-8f9f-95c4932b8564 service swift] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:41.132295 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f9741-ab9d-4e0b-8f9f-95c4932b8564 service swift] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:41.137673 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf038a-b26d-4da9-b201-a9226ce02e06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:41.138353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf038a-b26d-4da9-b201-a9226ce02e06 service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:41.138636 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf038a-b26d-4da9-b201-a9226ce02e06 service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:41.138910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf038a-b26d-4da9-b201-a9226ce02e06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:41.148117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf038a-b26d-4da9-b201-a9226ce02e06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:41.149699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf038a-b26d-4da9-b201-a9226ce02e06 service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:41.157889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1204/2429] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:39:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:39:41.370306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e1e9-48c6-4f86-9857-9314fb099b20 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:41.370594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e1e9-48c6-4f86-9857-9314fb099b20 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:41.370871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e1e9-48c6-4f86-9857-9314fb099b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:41.393871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8874e1e9-48c6-4f86-9857-9314fb099b20 None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:41.395132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8874e1e9-48c6-4f86-9857-9314fb099b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:41.402783 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1226/2430] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:39:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:41.415543 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf038a-b26d-4da9-b201-a9226ce02e06 service swift] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:41.427039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf038a-b26d-4da9-b201-a9226ce02e06 service swift] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:41.432856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d4288-f7cd-4ba0-b640-809af2f6dd21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:41.433510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d4288-f7cd-4ba0-b640-809af2f6dd21 service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:41.433820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d4288-f7cd-4ba0-b640-809af2f6dd21 service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:41.434096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d4288-f7cd-4ba0-b640-809af2f6dd21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:41.443731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d4288-f7cd-4ba0-b640-809af2f6dd21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:41.445328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d4288-f7cd-4ba0-b640-809af2f6dd21 service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:41.455248 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1205/2431] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:39:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:39:41.872326 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff37882-4a3b-44dd-8377-6c9095644452 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:41.872874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff37882-4a3b-44dd-8377-6c9095644452 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:41.873195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff37882-4a3b-44dd-8377-6c9095644452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:41.895382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-bff37882-4a3b-44dd-8377-6c9095644452 None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:41.896755 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bff37882-4a3b-44dd-8377-6c9095644452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:41.905416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1227/2432] 10.222.0.83 () {58 vars in 967 bytes} [Wed Dec 15 13:39:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:41.918499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d4288-f7cd-4ba0-b640-809af2f6dd21 service swift] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:41.928830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d4288-f7cd-4ba0-b640-809af2f6dd21 service swift] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:41.934073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddc123-c57c-448d-a486-27ad77eb6c4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:41.934717 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc123-c57c-448d-a486-27ad77eb6c4d service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:41.935048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc123-c57c-448d-a486-27ad77eb6c4d service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:41.935324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc123-c57c-448d-a486-27ad77eb6c4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:41.948125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddc123-c57c-448d-a486-27ad77eb6c4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:41.949993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddc123-c57c-448d-a486-27ad77eb6c4d service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:41.959389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1206/2433] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:39:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:39:42.227418 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff37882-4a3b-44dd-8377-6c9095644452 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:42.229506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bff37882-4a3b-44dd-8377-6c9095644452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:42.344941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff37882-4a3b-44dd-8377-6c9095644452 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:42.349579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39353c14-f0ca-4df7-8872-988298e6a449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:42.350483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39353c14-f0ca-4df7-8872-988298e6a449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:42.350789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39353c14-f0ca-4df7-8872-988298e6a449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:42.351040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39353c14-f0ca-4df7-8872-988298e6a449 admin admin] PATH_INFO: `/v3/users/66780c2cebcd40cfa78589c9b4cd4622` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:42.352311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39353c14-f0ca-4df7-8872-988298e6a449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66780c2cebcd40cfa78589c9b4cd4622)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:42.354498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39353c14-f0ca-4df7-8872-988298e6a449 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:42.404332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-39353c14-f0ca-4df7-8872-988298e6a449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66780c2cebcd40cfa78589c9b4cd4622'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:42.410931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-39353c14-f0ca-4df7-8872-988298e6a449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66780c2cebcd40cfa78589c9b4cd4622'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:42.411654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-39353c14-f0ca-4df7-8872-988298e6a449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66780c2cebcd40cfa78589c9b4cd4622'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:42.423430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-39353c14-f0ca-4df7-8872-988298e6a449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66780c2cebcd40cfa78589c9b4cd4622'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:42.424085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-39353c14-f0ca-4df7-8872-988298e6a449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66780c2cebcd40cfa78589c9b4cd4622'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:42.438183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1228/2434] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:39:42 2021] DELETE /identity/v3/users/66780c2cebcd40cfa78589c9b4cd4622 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:42.634311 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddc123-c57c-448d-a486-27ad77eb6c4d service swift] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:42.649105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddc123-c57c-448d-a486-27ad77eb6c4d service swift] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:42.741627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:42.742555 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:42.742873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:42.743180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] PATH_INFO: `/v3/projects/b3823701b6f1423aa1ecd29bf162e5db` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:42.744998 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3823701b6f1423aa1ecd29bf162e5db)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:42.747881 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:42.810106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3823701b6f1423aa1ecd29bf162e5db', 'request_id': 'req-b8bdab62-2322-476b-a963-3b6130cb6413'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:42.817451 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3823701b6f1423aa1ecd29bf162e5db', 'request_id': 'req-b8bdab62-2322-476b-a963-3b6130cb6413'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:42.826399 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3823701b6f1423aa1ecd29bf162e5db', 'request_id': 'req-b8bdab62-2322-476b-a963-3b6130cb6413'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:42.840446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] The token cache is being invalidate because project b3823701b6f1423aa1ecd29bf162e5db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:39:42.840950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:42.842126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-b8bdab62-2322-476b-a963-3b6130cb6413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:42.848134 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1207/2435] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:39:42 2021] DELETE /identity/v3/projects/b3823701b6f1423aa1ecd29bf162e5db => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:42.854453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8205-1587-4830-a268-3c8bd4746b90 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:42.854453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8205-1587-4830-a268-3c8bd4746b90 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:42.854453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8205-1587-4830-a268-3c8bd4746b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:42.921367 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-20bd8205-1587-4830-a268-3c8bd4746b90 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:42.922657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-20bd8205-1587-4830-a268-3c8bd4746b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:43.009602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1229/2436] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:43.011894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8838-186a-4a63-be16-f0d2ef613eb1 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:43.012534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8838-186a-4a63-be16-f0d2ef613eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:43.012534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8838-186a-4a63-be16-f0d2ef613eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:43.039557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-5d6b8838-186a-4a63-be16-f0d2ef613eb1 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:43.041156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-5d6b8838-186a-4a63-be16-f0d2ef613eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:43.053680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1208/2437] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:43.058648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd8205-1587-4830-a268-3c8bd4746b90 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:43.074892 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd8205-1587-4830-a268-3c8bd4746b90 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:43.078342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e239f71-7fc4-4579-b2d1-9f86e7d08d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:43.079352 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e239f71-7fc4-4579-b2d1-9f86e7d08d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:43.079637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e239f71-7fc4-4579-b2d1-9f86e7d08d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:43.080156 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e239f71-7fc4-4579-b2d1-9f86e7d08d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:43.080897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e239f71-7fc4-4579-b2d1-9f86e7d08d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:39:43.081195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e239f71-7fc4-4579-b2d1-9f86e7d08d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:43.082831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e239f71-7fc4-4579-b2d1-9f86e7d08d89 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:43.097922 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1230/2438] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:39:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:39:43.103059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b8838-186a-4a63-be16-f0d2ef613eb1 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:43.118766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b8838-186a-4a63-be16-f0d2ef613eb1 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:43.125825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ace92-f80d-4c17-9c1a-0d9667a372b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:43.126564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ace92-f80d-4c17-9c1a-0d9667a372b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:43.126876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ace92-f80d-4c17-9c1a-0d9667a372b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:43.127166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ace92-f80d-4c17-9c1a-0d9667a372b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:43.127914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ace92-f80d-4c17-9c1a-0d9667a372b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:43.129892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ace92-f80d-4c17-9c1a-0d9667a372b7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:43.161352 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1209/2439] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:39:43 2021] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:39:43.165543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e239f71-7fc4-4579-b2d1-9f86e7d08d89 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:43.176405 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e239f71-7fc4-4579-b2d1-9f86e7d08d89 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:43.251158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50776754-f46c-4280-92c7-593a2cf981cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:43.251980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50776754-f46c-4280-92c7-593a2cf981cc admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:43.252258 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50776754-f46c-4280-92c7-593a2cf981cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:43.252529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50776754-f46c-4280-92c7-593a2cf981cc admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:43.253305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50776754-f46c-4280-92c7-593a2cf981cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:43.255336 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50776754-f46c-4280-92c7-593a2cf981cc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:43.289494 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1231/2440] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:39:43 2021] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:39:43.291547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ace92-f80d-4c17-9c1a-0d9667a372b7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:43.305211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ace92-f80d-4c17-9c1a-0d9667a372b7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:43.313346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cce9c-2904-46a6-95d4-34479f187e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:43.314378 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cce9c-2904-46a6-95d4-34479f187e1c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:43.314657 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cce9c-2904-46a6-95d4-34479f187e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:43.314934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cce9c-2904-46a6-95d4-34479f187e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:43.315714 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cce9c-2904-46a6-95d4-34479f187e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:43.317315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cce9c-2904-46a6-95d4-34479f187e1c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:43.330676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1210/2441] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:39:43 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:39:43.334623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50776754-f46c-4280-92c7-593a2cf981cc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:43.345349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50776754-f46c-4280-92c7-593a2cf981cc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:43.350072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762484a-b209-4cd4-9dfb-ad663bd13ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:43.350826 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762484a-b209-4cd4-9dfb-ad663bd13ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:43.351121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762484a-b209-4cd4-9dfb-ad663bd13ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:43.351397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762484a-b209-4cd4-9dfb-ad663bd13ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:43.352131 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762484a-b209-4cd4-9dfb-ad663bd13ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:43.354347 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762484a-b209-4cd4-9dfb-ad663bd13ca0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:43.364544 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1232/2442] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:39:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:39:43.368798 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cce9c-2904-46a6-95d4-34479f187e1c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:43.379297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cce9c-2904-46a6-95d4-34479f187e1c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:43.384262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9de170-363a-4b14-9393-9e20ef79df3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:43.385179 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de170-363a-4b14-9393-9e20ef79df3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:43.385449 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de170-363a-4b14-9393-9e20ef79df3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:43.385720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de170-363a-4b14-9393-9e20ef79df3e admin admin] PATH_INFO: `/v3/projects/6e014c273a4f4109b238183ae25e8282/users/a6eb5d04091b4fda9e7cd38618df2f1f/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:43.401664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9de170-363a-4b14-9393-9e20ef79df3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e014c273a4f4109b238183ae25e8282, user_id=a6eb5d04091b4fda9e7cd38618df2f1f, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:43.404357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9de170-363a-4b14-9393-9e20ef79df3e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:43.420998 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1211/2443] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:39:43 2021] PUT /identity/v3/projects/6e014c273a4f4109b238183ae25e8282/users/a6eb5d04091b4fda9e7cd38618df2f1f/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:43.431630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc831-0f33-43de-88ba-df85e5d89227 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:43.432793 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc831-0f33-43de-88ba-df85e5d89227 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:43.433093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc831-0f33-43de-88ba-df85e5d89227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:43.459554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8edbc831-0f33-43de-88ba-df85e5d89227 None None] MFA Rules not processed for user `a6eb5d04091b4fda9e7cd38618df2f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:43.460762 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8edbc831-0f33-43de-88ba-df85e5d89227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:43.523972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1233/2444] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:43 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:43.534684 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9de170-363a-4b14-9393-9e20ef79df3e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:43.536427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0e9de170-363a-4b14-9393-9e20ef79df3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:43.614418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9de170-363a-4b14-9393-9e20ef79df3e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:43.618254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84acc1-e0be-4355-b125-2d43549a4316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:43.618902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84acc1-e0be-4355-b125-2d43549a4316 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:43.619215 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84acc1-e0be-4355-b125-2d43549a4316 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:43.620178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84acc1-e0be-4355-b125-2d43549a4316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:43.628896 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84acc1-e0be-4355-b125-2d43549a4316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:43.630500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84acc1-e0be-4355-b125-2d43549a4316 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:43.639562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1212/2445] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:39:43 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:39:44.098674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc831-0f33-43de-88ba-df85e5d89227 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:44.100150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8edbc831-0f33-43de-88ba-df85e5d89227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:44.164787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc831-0f33-43de-88ba-df85e5d89227 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:44.169955 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:44.170825 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:44.171102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:44.171372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] PATH_INFO: `/v3/users/bd856659215346d39dedfdb6648f90e8` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:44.172633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd856659215346d39dedfdb6648f90e8)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:44.174754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:44.219680 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd856659215346d39dedfdb6648f90e8'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:44.226188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd856659215346d39dedfdb6648f90e8'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:44.226849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd856659215346d39dedfdb6648f90e8'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:44.238360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd856659215346d39dedfdb6648f90e8'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:44.238998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd856659215346d39dedfdb6648f90e8'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:44.251900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1234/2446] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:39:44 2021] DELETE /identity/v3/users/bd856659215346d39dedfdb6648f90e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:44.256521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dd03b-307f-4d64-9a0d-3761ee05071d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:44.257012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dd03b-307f-4d64-9a0d-3761ee05071d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:44.257133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dd03b-307f-4d64-9a0d-3761ee05071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:44.277219 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-f18dd03b-307f-4d64-9a0d-3761ee05071d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:44.278475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f18dd03b-307f-4d64-9a0d-3761ee05071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:44.344276 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1213/2447] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:44.355081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:44.356596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:44.418938 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc71eb3-fcd6-457d-9363-6c5c77865331 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:44.423082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b6675-d009-4563-bd7a-3906bed099bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:44.423732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6675-d009-4563-bd7a-3906bed099bc service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:44.424014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6675-d009-4563-bd7a-3906bed099bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:44.424289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6675-d009-4563-bd7a-3906bed099bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:44.433931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b6675-d009-4563-bd7a-3906bed099bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:44.435356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b6675-d009-4563-bd7a-3906bed099bc service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:44.445072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1235/2448] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:39:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:39:44.668599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18dd03b-307f-4d64-9a0d-3761ee05071d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:44.670154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f18dd03b-307f-4d64-9a0d-3761ee05071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:44.700360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18dd03b-307f-4d64-9a0d-3761ee05071d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:44.706907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:44.707770 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:44.708048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:44.708348 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] PATH_INFO: `/v3/projects/3b040f42f67e4061b728e00adb165e5d` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:44.709547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b040f42f67e4061b728e00adb165e5d)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:44.711998 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:44.759952 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b040f42f67e4061b728e00adb165e5d', 'request_id': 'req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:44.771098 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b040f42f67e4061b728e00adb165e5d', 'request_id': 'req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:44.787171 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b040f42f67e4061b728e00adb165e5d', 'request_id': 'req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:44.802747 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] The token cache is being invalidate because project 3b040f42f67e4061b728e00adb165e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:39:44.803577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:44.814109 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1b3237ed-c9d6-4b27-ad1d-e7cb4cbf6ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:44.816873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1214/2449] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:39:44 2021] DELETE /identity/v3/projects/3b040f42f67e4061b728e00adb165e5d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:44.826478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c4f85-916b-436c-85d7-909d089ea731 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:44.826970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c4f85-916b-436c-85d7-909d089ea731 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:44.827449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c4f85-916b-436c-85d7-909d089ea731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:44.868375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e46c4f85-916b-436c-85d7-909d089ea731 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:44.870515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e46c4f85-916b-436c-85d7-909d089ea731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:44.960277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1236/2450] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:44.968407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a3f11-a11d-4630-805e-56af0470fa4e None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:44.968704 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a3f11-a11d-4630-805e-56af0470fa4e None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:44.968992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a3f11-a11d-4630-805e-56af0470fa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:45.004036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-eb7a3f11-a11d-4630-805e-56af0470fa4e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:45.005283 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-eb7a3f11-a11d-4630-805e-56af0470fa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:45.016827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1215/2451] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:45.017924 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c4f85-916b-436c-85d7-909d089ea731 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:45.033012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c4f85-916b-436c-85d7-909d089ea731 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:45.038336 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e087675-07b5-46a0-befa-1fcc288dfdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:45.039074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e087675-07b5-46a0-befa-1fcc288dfdbb admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:45.039447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e087675-07b5-46a0-befa-1fcc288dfdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:45.039796 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e087675-07b5-46a0-befa-1fcc288dfdbb admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:45.040644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e087675-07b5-46a0-befa-1fcc288dfdbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:39:45.041704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e087675-07b5-46a0-befa-1fcc288dfdbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:45.043670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e087675-07b5-46a0-befa-1fcc288dfdbb admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:45.061407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1237/2452] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:39:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:39:45.062595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a3f11-a11d-4630-805e-56af0470fa4e None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:45.077505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a3f11-a11d-4630-805e-56af0470fa4e None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:45.083383 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ad82d-710e-450f-bd06-c51c2b180af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:45.084136 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad82d-710e-450f-bd06-c51c2b180af1 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:45.084486 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad82d-710e-450f-bd06-c51c2b180af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:45.084845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad82d-710e-450f-bd06-c51c2b180af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:45.085620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ad82d-710e-450f-bd06-c51c2b180af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:45.087630 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ad82d-710e-450f-bd06-c51c2b180af1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:45.122276 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1216/2453] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:39:45 2021] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:39:45.124490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e087675-07b5-46a0-befa-1fcc288dfdbb admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:45.135360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e087675-07b5-46a0-befa-1fcc288dfdbb admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:45.196062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89d615-6f0f-4ec5-8c90-3990b81760d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:45.196729 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89d615-6f0f-4ec5-8c90-3990b81760d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:45.197009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89d615-6f0f-4ec5-8c90-3990b81760d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:45.197275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89d615-6f0f-4ec5-8c90-3990b81760d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:45.198052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89d615-6f0f-4ec5-8c90-3990b81760d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:45.199954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89d615-6f0f-4ec5-8c90-3990b81760d3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:45.222016 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1238/2454] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:39:45 2021] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:39:45.227861 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ad82d-710e-450f-bd06-c51c2b180af1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:45.243330 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ad82d-710e-450f-bd06-c51c2b180af1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:45.251894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53321500-e38d-4efa-99e6-21d0c0ed496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:45.253047 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321500-e38d-4efa-99e6-21d0c0ed496b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:45.253553 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321500-e38d-4efa-99e6-21d0c0ed496b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:45.254094 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321500-e38d-4efa-99e6-21d0c0ed496b admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:45.255309 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53321500-e38d-4efa-99e6-21d0c0ed496b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:45.258299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53321500-e38d-4efa-99e6-21d0c0ed496b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:45.280480 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1217/2455] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:39:45 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:39:45.281740 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89d615-6f0f-4ec5-8c90-3990b81760d3 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:45.292101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89d615-6f0f-4ec5-8c90-3990b81760d3 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:45.296688 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd508a86-d04c-4290-a283-09d71fa3ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:45.297339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508a86-d04c-4290-a283-09d71fa3ac22 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:45.297615 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508a86-d04c-4290-a283-09d71fa3ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:45.297926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508a86-d04c-4290-a283-09d71fa3ac22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:45.298655 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd508a86-d04c-4290-a283-09d71fa3ac22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:45.300217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd508a86-d04c-4290-a283-09d71fa3ac22 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:45.310255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1239/2456] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:39:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:39:45.314279 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53321500-e38d-4efa-99e6-21d0c0ed496b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:45.324003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53321500-e38d-4efa-99e6-21d0c0ed496b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:45.329235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb85301-bc55-4413-99f3-977cca1e6173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:45.330446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb85301-bc55-4413-99f3-977cca1e6173 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:45.330712 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb85301-bc55-4413-99f3-977cca1e6173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:45.330987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb85301-bc55-4413-99f3-977cca1e6173 admin admin] PATH_INFO: `/v3/projects/56ce01ca50734f87ad8566b49ea5292a/users/01a989a159d14d8099e2f9b5ee46f1f9/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:45.347791 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb85301-bc55-4413-99f3-977cca1e6173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ce01ca50734f87ad8566b49ea5292a, user_id=01a989a159d14d8099e2f9b5ee46f1f9, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:45.350496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb85301-bc55-4413-99f3-977cca1e6173 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:45.364002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1218/2457] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:39:45 2021] PUT /identity/v3/projects/56ce01ca50734f87ad8566b49ea5292a/users/01a989a159d14d8099e2f9b5ee46f1f9/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:45.368971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f135-ca26-44f4-be27-2ddfbc4c370d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:45.369258 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f135-ca26-44f4-be27-2ddfbc4c370d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:45.369561 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f135-ca26-44f4-be27-2ddfbc4c370d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:45.387633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-3331f135-ca26-44f4-be27-2ddfbc4c370d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:45.388848 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3331f135-ca26-44f4-be27-2ddfbc4c370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:45.449922 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1240/2458] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:45.459830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb85301-bc55-4413-99f3-977cca1e6173 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:45.461511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1eb85301-bc55-4413-99f3-977cca1e6173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:45.516994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb85301-bc55-4413-99f3-977cca1e6173 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:45.520844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187489c6-a006-44a2-80ae-f6f02f0fa183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:45.521548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187489c6-a006-44a2-80ae-f6f02f0fa183 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:45.521734 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187489c6-a006-44a2-80ae-f6f02f0fa183 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:45.522034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187489c6-a006-44a2-80ae-f6f02f0fa183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:45.531789 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187489c6-a006-44a2-80ae-f6f02f0fa183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:45.533207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187489c6-a006-44a2-80ae-f6f02f0fa183 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:45.550059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1219/2459] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:39:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:39:46.196113 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f135-ca26-44f4-be27-2ddfbc4c370d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:46.198456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3331f135-ca26-44f4-be27-2ddfbc4c370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:46.210379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f135-ca26-44f4-be27-2ddfbc4c370d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:46.215044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:46.215913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:46.216198 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:46.216503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] PATH_INFO: `/v3/users/a6eb5d04091b4fda9e7cd38618df2f1f` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:46.218646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6eb5d04091b4fda9e7cd38618df2f1f)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:46.220787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:46.291797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6eb5d04091b4fda9e7cd38618df2f1f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:46.300447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6eb5d04091b4fda9e7cd38618df2f1f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:46.302594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6eb5d04091b4fda9e7cd38618df2f1f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:46.316847 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6eb5d04091b4fda9e7cd38618df2f1f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:46.318888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6eb5d04091b4fda9e7cd38618df2f1f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:46.338803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1241/2460] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:39:46 2021] DELETE /identity/v3/users/a6eb5d04091b4fda9e7cd38618df2f1f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:46.344956 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dda0d-f24b-4c30-a414-2359a1cd7a3a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:46.345723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dda0d-f24b-4c30-a414-2359a1cd7a3a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:46.345723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dda0d-f24b-4c30-a414-2359a1cd7a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:46.365183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-047dda0d-f24b-4c30-a414-2359a1cd7a3a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:46.366772 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-047dda0d-f24b-4c30-a414-2359a1cd7a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:46.433405 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1220/2461] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:39:46.444542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:46.446268 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:46.522513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24014a6-fdcd-497e-bade-ceda2017f05b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:46.527024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68954c6f-2cb5-40fd-9b88-fc63fcce4c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:46.527693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954c6f-2cb5-40fd-9b88-fc63fcce4c84 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:46.527968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954c6f-2cb5-40fd-9b88-fc63fcce4c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:46.528245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954c6f-2cb5-40fd-9b88-fc63fcce4c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:46.538510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954c6f-2cb5-40fd-9b88-fc63fcce4c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:46.539947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954c6f-2cb5-40fd-9b88-fc63fcce4c84 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:46.551093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1242/2462] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:39:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:39:47.305582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dda0d-f24b-4c30-a414-2359a1cd7a3a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:47.307187 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-047dda0d-f24b-4c30-a414-2359a1cd7a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:47.331858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dda0d-f24b-4c30-a414-2359a1cd7a3a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:47.342093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:47.342969 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:47.343270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:47.343519 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] PATH_INFO: `/v3/projects/6e014c273a4f4109b238183ae25e8282` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:47.345318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e014c273a4f4109b238183ae25e8282)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:47.357972 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:47.420430 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e014c273a4f4109b238183ae25e8282', 'request_id': 'req-12738d14-31e7-4bfa-815e-51fb4ac17311'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:47.426999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e014c273a4f4109b238183ae25e8282', 'request_id': 'req-12738d14-31e7-4bfa-815e-51fb4ac17311'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:47.437398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e014c273a4f4109b238183ae25e8282', 'request_id': 'req-12738d14-31e7-4bfa-815e-51fb4ac17311'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:47.450391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] The token cache is being invalidate because project 6e014c273a4f4109b238183ae25e8282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:39:47.450909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:47.451786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-12738d14-31e7-4bfa-815e-51fb4ac17311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:39:47.453942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1221/2463] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:39:47 2021] DELETE /identity/v3/projects/6e014c273a4f4109b238183ae25e8282 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:48.533819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68954c6f-2cb5-40fd-9b88-fc63fcce4c84 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:48.536104 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-68954c6f-2cb5-40fd-9b88-fc63fcce4c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:48.684528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68954c6f-2cb5-40fd-9b88-fc63fcce4c84 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:48.857674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aaecb-faea-4f80-9d56-1b9925c903fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b1d42ac3a427bb084740a069b577d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:48.859470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aaecb-faea-4f80-9d56-1b9925c903fd service placement] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:48.860019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aaecb-faea-4f80-9d56-1b9925c903fd service placement] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:48.860444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aaecb-faea-4f80-9d56-1b9925c903fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:48.863973 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2e4aaecb-faea-4f80-9d56-1b9925c903fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:48.892715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aaecb-faea-4f80-9d56-1b9925c903fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:48.895295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aaecb-faea-4f80-9d56-1b9925c903fd service placement] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:48.914291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1243/2464] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:39:48 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:39:51.456890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204c182-a9c0-40be-aa72-26f9ae33a3ae None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:51.457930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204c182-a9c0-40be-aa72-26f9ae33a3ae None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:51.458462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204c182-a9c0-40be-aa72-26f9ae33a3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:51.500703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-0204c182-a9c0-40be-aa72-26f9ae33a3ae None None] MFA Rules not processed for user `01a989a159d14d8099e2f9b5ee46f1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:51.501962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0204c182-a9c0-40be-aa72-26f9ae33a3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:51.573547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1222/2465] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:51 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:51.577580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aaecb-faea-4f80-9d56-1b9925c903fd service placement] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:51.579133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2e4aaecb-faea-4f80-9d56-1b9925c903fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:51.693579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aaecb-faea-4f80-9d56-1b9925c903fd service placement] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:51.699401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf95b7-0fac-4758-b9c1-86b328634bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:51.702286 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf95b7-0fac-4758-b9c1-86b328634bdc admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:51.703027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf95b7-0fac-4758-b9c1-86b328634bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:51.703693 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf95b7-0fac-4758-b9c1-86b328634bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:51.704608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf95b7-0fac-4758-b9c1-86b328634bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:51.725318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf95b7-0fac-4758-b9c1-86b328634bdc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:51.775142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1244/2466] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:39:51 2021] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:39:51.779416 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204c182-a9c0-40be-aa72-26f9ae33a3ae None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:51.791086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204c182-a9c0-40be-aa72-26f9ae33a3ae None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:51.871427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd164-8559-4133-a60d-301234bf8831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:51.872350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd164-8559-4133-a60d-301234bf8831 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:51.872650 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd164-8559-4133-a60d-301234bf8831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:51.873014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd164-8559-4133-a60d-301234bf8831 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:51.873865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecd164-8559-4133-a60d-301234bf8831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:51.876022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecd164-8559-4133-a60d-301234bf8831 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:51.898859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1223/2467] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:39:51 2021] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:39:51.903522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf95b7-0fac-4758-b9c1-86b328634bdc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:51.918347 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf95b7-0fac-4758-b9c1-86b328634bdc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:51.924215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cd3fe-0433-4a85-a529-f42ac99811a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:51.924962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cd3fe-0433-4a85-a529-f42ac99811a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:51.926043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cd3fe-0433-4a85-a529-f42ac99811a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:51.926396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cd3fe-0433-4a85-a529-f42ac99811a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:51.927219 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cd3fe-0433-4a85-a529-f42ac99811a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:51.929319 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cd3fe-0433-4a85-a529-f42ac99811a5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:51.941557 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1245/2468] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:39:51 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:39:51.945628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd164-8559-4133-a60d-301234bf8831 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:51.956124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd164-8559-4133-a60d-301234bf8831 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:51.961074 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a92b68-524b-4f88-91c6-a90e370864c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:51.962103 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92b68-524b-4f88-91c6-a90e370864c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:51.962612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92b68-524b-4f88-91c6-a90e370864c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:51.963121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92b68-524b-4f88-91c6-a90e370864c8 admin admin] PATH_INFO: `/v3/projects/e7cbbb43ec734d67bf4f796e58f5a8ff/users/65e6b6dd43634a759e3be43424561d5e/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:51.979445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a92b68-524b-4f88-91c6-a90e370864c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cbbb43ec734d67bf4f796e58f5a8ff, user_id=65e6b6dd43634a759e3be43424561d5e, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:51.982237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a92b68-524b-4f88-91c6-a90e370864c8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:51.999680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1224/2469] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:39:51 2021] PUT /identity/v3/projects/e7cbbb43ec734d67bf4f796e58f5a8ff/users/65e6b6dd43634a759e3be43424561d5e/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:52.003641 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cd3fe-0433-4a85-a529-f42ac99811a5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:52.017042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cd3fe-0433-4a85-a529-f42ac99811a5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:52.085643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327c979-59e9-4b57-ac09-c5cfb2861b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:52.087303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327c979-59e9-4b57-ac09-c5cfb2861b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:52.087303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327c979-59e9-4b57-ac09-c5cfb2861b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:52.088518 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327c979-59e9-4b57-ac09-c5cfb2861b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:52.089083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327c979-59e9-4b57-ac09-c5cfb2861b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:52.092227 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327c979-59e9-4b57-ac09-c5cfb2861b5a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:52.111506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1246/2470] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:39:52 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:39:52.116388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a92b68-524b-4f88-91c6-a90e370864c8 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:52.134627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a92b68-524b-4f88-91c6-a90e370864c8 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:52.143155 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a99b7-cd2b-4a7a-81bc-f469b1b48111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:52.144729 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a99b7-cd2b-4a7a-81bc-f469b1b48111 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:52.145239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a99b7-cd2b-4a7a-81bc-f469b1b48111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:52.145741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a99b7-cd2b-4a7a-81bc-f469b1b48111 admin admin] PATH_INFO: `/v3/projects/e7cbbb43ec734d67bf4f796e58f5a8ff/users/65e6b6dd43634a759e3be43424561d5e/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:52.149332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a99b7-cd2b-4a7a-81bc-f469b1b48111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cbbb43ec734d67bf4f796e58f5a8ff, user_id=65e6b6dd43634a759e3be43424561d5e, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:52.154774 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a99b7-cd2b-4a7a-81bc-f469b1b48111 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:52.172875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1225/2471] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:39:52 2021] PUT /identity/v3/projects/e7cbbb43ec734d67bf4f796e58f5a8ff/users/65e6b6dd43634a759e3be43424561d5e/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:39:57.915393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d1162-e3af-4748-b71d-5f016425eee1 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:57.915931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d1162-e3af-4748-b71d-5f016425eee1 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:57.916030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d1162-e3af-4748-b71d-5f016425eee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:57.954349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a59d1162-e3af-4748-b71d-5f016425eee1 None None] MFA Rules not processed for user `65e6b6dd43634a759e3be43424561d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:57.955835 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a59d1162-e3af-4748-b71d-5f016425eee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:58.046246 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1247/2472] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:39:57 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:58.059638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a99b7-cd2b-4a7a-81bc-f469b1b48111 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:58.061938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1c9a99b7-cd2b-4a7a-81bc-f469b1b48111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:58.128937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a99b7-cd2b-4a7a-81bc-f469b1b48111 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:58.139882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618d18-c4c5-4374-ad99-5ebf76287dba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ddafedf2734326832ab4bf620f7634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:58.140535 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618d18-c4c5-4374-ad99-5ebf76287dba service glance] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:58.140783 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618d18-c4c5-4374-ad99-5ebf76287dba service glance] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:58.141062 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618d18-c4c5-4374-ad99-5ebf76287dba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:58.218163 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34618d18-c4c5-4374-ad99-5ebf76287dba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:58.219653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34618d18-c4c5-4374-ad99-5ebf76287dba service glance] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:58.229441 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1226/2473] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:39:58 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:39:58.358303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bf2d1-4659-4c06-be23-614045d6dffd None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:58.358721 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bf2d1-4659-4c06-be23-614045d6dffd None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:58.359131 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bf2d1-4659-4c06-be23-614045d6dffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:58.381221 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-d37bf2d1-4659-4c06-be23-614045d6dffd None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:39:58.382467 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d37bf2d1-4659-4c06-be23-614045d6dffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:58.443396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1248/2474] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:39:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:39:58.458344 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618d18-c4c5-4374-ad99-5ebf76287dba service glance] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:39:58.459761 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-34618d18-c4c5-4374-ad99-5ebf76287dba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:39:58.528690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618d18-c4c5-4374-ad99-5ebf76287dba service glance] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:39:58.533699 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f8b4d-a4b1-4ad2-a475-0a916ba4c99c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:39:58.534388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8b4d-a4b1-4ad2-a475-0a916ba4c99c service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:39:58.534664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8b4d-a4b1-4ad2-a475-0a916ba4c99c service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:39:58.534962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8b4d-a4b1-4ad2-a475-0a916ba4c99c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:39:58.544124 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f8b4d-a4b1-4ad2-a475-0a916ba4c99c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:39:58.545711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f8b4d-a4b1-4ad2-a475-0a916ba4c99c service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:39:58.554267 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1227/2475] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:39:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:40:07.252716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bf2d1-4659-4c06-be23-614045d6dffd None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:07.254190 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d37bf2d1-4659-4c06-be23-614045d6dffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:07.330915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bf2d1-4659-4c06-be23-614045d6dffd None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:07.336169 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:07.337510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:07.337510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:07.337700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] PATH_INFO: `/v3/users/457424d49d4a41b383fe3d387b763d5d` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:07.339428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=457424d49d4a41b383fe3d387b763d5d)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:07.341635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:07.399356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457424d49d4a41b383fe3d387b763d5d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:07.407717 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457424d49d4a41b383fe3d387b763d5d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:07.408423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457424d49d4a41b383fe3d387b763d5d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:07.427916 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457424d49d4a41b383fe3d387b763d5d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:07.428935 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457424d49d4a41b383fe3d387b763d5d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:07.449379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1249/2476] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:40:07 2021] DELETE /identity/v3/users/457424d49d4a41b383fe3d387b763d5d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:40:07.455571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144ef18-4849-4c08-a4bb-8b43d02bc66b None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:07.456363 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144ef18-4849-4c08-a4bb-8b43d02bc66b None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:07.456447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144ef18-4849-4c08-a4bb-8b43d02bc66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:07.476948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c144ef18-4849-4c08-a4bb-8b43d02bc66b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:07.478206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c144ef18-4849-4c08-a4bb-8b43d02bc66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:07.557631 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1228/2477] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:40:07.564723 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:07.566207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:07.643306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e1ee9-e724-42b2-bc33-d9cd058044f4 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:07.659465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4512aa-e277-4e22-b2ec-7318f136797e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:07.660417 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4512aa-e277-4e22-b2ec-7318f136797e service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:07.661058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4512aa-e277-4e22-b2ec-7318f136797e service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:07.661546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4512aa-e277-4e22-b2ec-7318f136797e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:07.673238 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4512aa-e277-4e22-b2ec-7318f136797e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:07.675121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4512aa-e277-4e22-b2ec-7318f136797e service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:07.688799 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1250/2478] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:40:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:40:08.147000 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144ef18-4849-4c08-a4bb-8b43d02bc66b None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:08.148978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c144ef18-4849-4c08-a4bb-8b43d02bc66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:08.172156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144ef18-4849-4c08-a4bb-8b43d02bc66b None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:08.178936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:08.179875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.180156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.180425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] PATH_INFO: `/v3/projects/0693149e3ea245fdaea28d9e18cd886d` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.181746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0693149e3ea245fdaea28d9e18cd886d)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:08.185233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:08.268153 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0693149e3ea245fdaea28d9e18cd886d', 'request_id': 'req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:08.277184 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0693149e3ea245fdaea28d9e18cd886d', 'request_id': 'req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:08.286040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0693149e3ea245fdaea28d9e18cd886d', 'request_id': 'req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:08.299397 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] The token cache is being invalidate because project 0693149e3ea245fdaea28d9e18cd886d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:40:08.299839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:08.302217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c09545ba-881c-4fe9-bde6-2f5bfe3f94c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:08.304175 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1229/2479] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:40:08 2021] DELETE /identity/v3/projects/0693149e3ea245fdaea28d9e18cd886d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:40:08.310647 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a680469-fc78-4773-bf10-c897883b70b4 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.312088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a680469-fc78-4773-bf10-c897883b70b4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.312688 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a680469-fc78-4773-bf10-c897883b70b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.340986 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-6a680469-fc78-4773-bf10-c897883b70b4 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:08.342594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6a680469-fc78-4773-bf10-c897883b70b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:08.408834 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1251/2480] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:08.416517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b1d50-df50-4736-811e-e5c3e63a2a60 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.417325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b1d50-df50-4736-811e-e5c3e63a2a60 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.417603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b1d50-df50-4736-811e-e5c3e63a2a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.436059 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-dc0b1d50-df50-4736-811e-e5c3e63a2a60 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:08.437324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-dc0b1d50-df50-4736-811e-e5c3e63a2a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:08.445121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1230/2481] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:08.449350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a680469-fc78-4773-bf10-c897883b70b4 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:08.459359 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a680469-fc78-4773-bf10-c897883b70b4 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:08.463931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c796c-de4f-4674-94f2-6d519c1f74f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:08.464578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c796c-de4f-4674-94f2-6d519c1f74f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.464858 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c796c-de4f-4674-94f2-6d519c1f74f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.465132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c796c-de4f-4674-94f2-6d519c1f74f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.465898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c796c-de4f-4674-94f2-6d519c1f74f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:40:08.466205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c796c-de4f-4674-94f2-6d519c1f74f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:08.467785 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c796c-de4f-4674-94f2-6d519c1f74f1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:08.479798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1252/2482] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:40:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:40:08.484035 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b1d50-df50-4736-811e-e5c3e63a2a60 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:08.494019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b1d50-df50-4736-811e-e5c3e63a2a60 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:08.499632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188fb2a-897b-4fa6-b4ea-0f21f8b8f8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:08.500387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188fb2a-897b-4fa6-b4ea-0f21f8b8f8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.500669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188fb2a-897b-4fa6-b4ea-0f21f8b8f8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.500946 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188fb2a-897b-4fa6-b4ea-0f21f8b8f8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.501893 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188fb2a-897b-4fa6-b4ea-0f21f8b8f8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:08.503674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188fb2a-897b-4fa6-b4ea-0f21f8b8f8a6 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:08.529876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1231/2483] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:40:08 2021] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:40:08.533634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188fb2a-897b-4fa6-b4ea-0f21f8b8f8a6 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:08.534378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d09e3-7d2d-4707-9f88-6d992d44babe None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.534672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d09e3-7d2d-4707-9f88-6d992d44babe None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.534953 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d09e3-7d2d-4707-9f88-6d992d44babe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.552939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a32d09e3-7d2d-4707-9f88-6d992d44babe None None] MFA Rules not processed for user `01a989a159d14d8099e2f9b5ee46f1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:08.554167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a32d09e3-7d2d-4707-9f88-6d992d44babe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:08.593930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188fb2a-897b-4fa6-b4ea-0f21f8b8f8a6 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:08.598787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a436e0d-23cb-4c7b-b28b-9a4cc0961920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:08.599502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436e0d-23cb-4c7b-b28b-9a4cc0961920 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.599856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436e0d-23cb-4c7b-b28b-9a4cc0961920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.600135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436e0d-23cb-4c7b-b28b-9a4cc0961920 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.600855 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a436e0d-23cb-4c7b-b28b-9a4cc0961920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:08.602796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a436e0d-23cb-4c7b-b28b-9a4cc0961920 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:08.610863 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1253/2484] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:08 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:08.625801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1232/2485] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:40:08 2021] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:40:08.629424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d09e3-7d2d-4707-9f88-6d992d44babe None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:08.640676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d09e3-7d2d-4707-9f88-6d992d44babe None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:08.645361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ca6f9-1686-458c-9c02-e315fe8bfbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:08.646064 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ca6f9-1686-458c-9c02-e315fe8bfbdf admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.646348 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ca6f9-1686-458c-9c02-e315fe8bfbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.646616 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ca6f9-1686-458c-9c02-e315fe8bfbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.647344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ca6f9-1686-458c-9c02-e315fe8bfbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:08.648906 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ca6f9-1686-458c-9c02-e315fe8bfbdf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:08.659575 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1254/2486] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:40:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:40:08.663475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a436e0d-23cb-4c7b-b28b-9a4cc0961920 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:08.674240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a436e0d-23cb-4c7b-b28b-9a4cc0961920 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:08.678901 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0268f7a-99a1-4f6e-b887-502da7e52ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:08.679558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268f7a-99a1-4f6e-b887-502da7e52ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.679839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268f7a-99a1-4f6e-b887-502da7e52ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.680117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268f7a-99a1-4f6e-b887-502da7e52ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.680843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0268f7a-99a1-4f6e-b887-502da7e52ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:08.682503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0268f7a-99a1-4f6e-b887-502da7e52ba7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:08.692696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1233/2487] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:40:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:40:08.696727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ca6f9-1686-458c-9c02-e315fe8bfbdf admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:08.706760 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ca6f9-1686-458c-9c02-e315fe8bfbdf admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:08.711737 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32e440-af78-4537-a7ed-3a3038a801c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:08.712649 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e440-af78-4537-a7ed-3a3038a801c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.712951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e440-af78-4537-a7ed-3a3038a801c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.713225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e440-af78-4537-a7ed-3a3038a801c7 admin admin] PATH_INFO: `/v3/projects/97b34cbbdf834564ac49315acccf7b2f/users/d3d4298c32524a4e9e5677bb451fd70e/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.729041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32e440-af78-4537-a7ed-3a3038a801c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b34cbbdf834564ac49315acccf7b2f, user_id=d3d4298c32524a4e9e5677bb451fd70e, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:08.732465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32e440-af78-4537-a7ed-3a3038a801c7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:08.746224 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1255/2488] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:40:08 2021] PUT /identity/v3/projects/97b34cbbdf834564ac49315acccf7b2f/users/d3d4298c32524a4e9e5677bb451fd70e/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:40:08.757167 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9975c-3f09-4277-b9ce-b4534a0787c3 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.757450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9975c-3f09-4277-b9ce-b4534a0787c3 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.757724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9975c-3f09-4277-b9ce-b4534a0787c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.784306 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-fca9975c-3f09-4277-b9ce-b4534a0787c3 None None] MFA Rules not processed for user `d3d4298c32524a4e9e5677bb451fd70e`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:08.785559 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fca9975c-3f09-4277-b9ce-b4534a0787c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:08.856649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1234/2489] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:08 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:08.867439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32e440-af78-4537-a7ed-3a3038a801c7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:08.869369 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4a32e440-af78-4537-a7ed-3a3038a801c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:08.927928 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32e440-af78-4537-a7ed-3a3038a801c7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:08.931507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d22c7f-0cbb-4d59-a1a2-84558033bf67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:08.932278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22c7f-0cbb-4d59-a1a2-84558033bf67 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:08.932450 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22c7f-0cbb-4d59-a1a2-84558033bf67 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:08.932727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22c7f-0cbb-4d59-a1a2-84558033bf67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:08.941232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d22c7f-0cbb-4d59-a1a2-84558033bf67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:08.942705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d22c7f-0cbb-4d59-a1a2-84558033bf67 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:08.952584 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1256/2490] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:40:08 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:40:09.664809 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9975c-3f09-4277-b9ce-b4534a0787c3 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:09.666260 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fca9975c-3f09-4277-b9ce-b4534a0787c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:09.728039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9975c-3f09-4277-b9ce-b4534a0787c3 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:09.732301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60214302-400f-4937-a4c5-71460bf1760e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:09.732981 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60214302-400f-4937-a4c5-71460bf1760e service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:09.733263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60214302-400f-4937-a4c5-71460bf1760e service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:09.733538 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60214302-400f-4937-a4c5-71460bf1760e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:09.735416 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-60214302-400f-4937-a4c5-71460bf1760e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:09.799096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60214302-400f-4937-a4c5-71460bf1760e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:09.800658 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60214302-400f-4937-a4c5-71460bf1760e service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:09.810900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1235/2491] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:40:09 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:40:10.624508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac819e-30c4-4b18-b170-67307c4059b4 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:10.625343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac819e-30c4-4b18-b170-67307c4059b4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:10.625527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac819e-30c4-4b18-b170-67307c4059b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:10.720586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-dbac819e-30c4-4b18-b170-67307c4059b4 None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:10.722563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-dbac819e-30c4-4b18-b170-67307c4059b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:10.849185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1257/2492] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:40:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:40:10.873276 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60214302-400f-4937-a4c5-71460bf1760e service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:10.874892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-60214302-400f-4937-a4c5-71460bf1760e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:11.010343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60214302-400f-4937-a4c5-71460bf1760e service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:11.018884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fe519-d95e-4b1f-8c74-3d3627be3cb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:11.019686 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe519-d95e-4b1f-8c74-3d3627be3cb0 service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:11.020093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe519-d95e-4b1f-8c74-3d3627be3cb0 service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:11.020465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe519-d95e-4b1f-8c74-3d3627be3cb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:11.032404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fe519-d95e-4b1f-8c74-3d3627be3cb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:11.034439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fe519-d95e-4b1f-8c74-3d3627be3cb0 service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:11.077878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1236/2493] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:40:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:40:17.269640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac819e-30c4-4b18-b170-67307c4059b4 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:17.338142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac819e-30c4-4b18-b170-67307c4059b4 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:17.342597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:17.343487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:17.343761 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:17.344032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] PATH_INFO: `/v3/users/d3d4298c32524a4e9e5677bb451fd70e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:17.345232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d4298c32524a4e9e5677bb451fd70e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:17.347516 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:17.396542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d4298c32524a4e9e5677bb451fd70e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:17.403201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d4298c32524a4e9e5677bb451fd70e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:17.403874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d4298c32524a4e9e5677bb451fd70e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:17.415425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d4298c32524a4e9e5677bb451fd70e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:17.416470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d4298c32524a4e9e5677bb451fd70e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:17.429486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1258/2494] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:40:17 2021] DELETE /identity/v3/users/d3d4298c32524a4e9e5677bb451fd70e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:40:17.434943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cefb2-676b-410c-9e22-175c577fa585 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:17.435502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cefb2-676b-410c-9e22-175c577fa585 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:17.435502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cefb2-676b-410c-9e22-175c577fa585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:17.457522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c78cefb2-676b-410c-9e22-175c577fa585 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:17.459880 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c78cefb2-676b-410c-9e22-175c577fa585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:17.530978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1237/2495] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:17.541066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:17.543059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:17.621529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97781053-4d40-4906-b943-42b1ae316135 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:17.625234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57923-931e-4f80-bb93-179588a0894e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:17.625943 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57923-931e-4f80-bb93-179588a0894e service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:17.626225 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57923-931e-4f80-bb93-179588a0894e service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:17.626500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57923-931e-4f80-bb93-179588a0894e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:17.635610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae57923-931e-4f80-bb93-179588a0894e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:17.637034 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae57923-931e-4f80-bb93-179588a0894e service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:17.646369 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1259/2496] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:40:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:40:17.927457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cefb2-676b-410c-9e22-175c577fa585 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:17.928888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c78cefb2-676b-410c-9e22-175c577fa585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:17.944311 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cefb2-676b-410c-9e22-175c577fa585 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:17.949856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:17.950856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:17.951239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:17.951609 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] PATH_INFO: `/v3/projects/97b34cbbdf834564ac49315acccf7b2f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:17.953233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b34cbbdf834564ac49315acccf7b2f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:17.955866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:18.039870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b34cbbdf834564ac49315acccf7b2f', 'request_id': 'req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:18.060673 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b34cbbdf834564ac49315acccf7b2f', 'request_id': 'req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:18.069932 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b34cbbdf834564ac49315acccf7b2f', 'request_id': 'req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:18.082231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] The token cache is being invalidate because project 97b34cbbdf834564ac49315acccf7b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:40:18.082521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:18.083186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:18.084766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1238/2497] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:40:17 2021] DELETE /identity/v3/projects/97b34cbbdf834564ac49315acccf7b2f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:40:30.152317 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57923-931e-4f80-bb93-179588a0894e service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:30.153903 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9ae57923-931e-4f80-bb93-179588a0894e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:30.181251 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57923-931e-4f80-bb93-179588a0894e service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:30.324814 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b1434-dc60-47da-aae4-eaa6c04ff4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:30.326052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b1434-dc60-47da-aae4-eaa6c04ff4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:30.326563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b1434-dc60-47da-aae4-eaa6c04ff4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:30.327069 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b1434-dc60-47da-aae4-eaa6c04ff4b3 admin admin] PATH_INFO: `/v3/users/0a11e7a0c33b4df38bdb713cffe43911` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:30.329725 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b1434-dc60-47da-aae4-eaa6c04ff4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a11e7a0c33b4df38bdb713cffe43911)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:30.333849 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b1434-dc60-47da-aae4-eaa6c04ff4b3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:30.401700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-833b1434-dc60-47da-aae4-eaa6c04ff4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a11e7a0c33b4df38bdb713cffe43911'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:30.410305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-833b1434-dc60-47da-aae4-eaa6c04ff4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a11e7a0c33b4df38bdb713cffe43911'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:30.411882 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-833b1434-dc60-47da-aae4-eaa6c04ff4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a11e7a0c33b4df38bdb713cffe43911'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:30.425674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-833b1434-dc60-47da-aae4-eaa6c04ff4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a11e7a0c33b4df38bdb713cffe43911'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:30.426534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-833b1434-dc60-47da-aae4-eaa6c04ff4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a11e7a0c33b4df38bdb713cffe43911'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:30.441090 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1260/2498] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:40:30 2021] DELETE /identity/v3/users/0a11e7a0c33b4df38bdb713cffe43911 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:40:30.660940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:30.661871 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:30.684128 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4ea6e-d754-4db5-b5b9-d294453bc9bd admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:30.816924 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:30.818463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:30.818816 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:30.819165 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] PATH_INFO: `/v3/projects/91da5641066242d99b74a660383a26da` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:30.820731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] RBAC: Authorizing `identity:delete_project(project_id=91da5641066242d99b74a660383a26da)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:30.823278 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:30.887240 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91da5641066242d99b74a660383a26da', 'request_id': 'req-6650f4c0-a17d-42dc-9de0-c3af8769f67c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:30.898882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91da5641066242d99b74a660383a26da', 'request_id': 'req-6650f4c0-a17d-42dc-9de0-c3af8769f67c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:30.912656 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91da5641066242d99b74a660383a26da', 'request_id': 'req-6650f4c0-a17d-42dc-9de0-c3af8769f67c'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:30.939858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] The token cache is being invalidate because project 91da5641066242d99b74a660383a26da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:40:30.940446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:30.941400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-6650f4c0-a17d-42dc-9de0-c3af8769f67c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:40:30.944243 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1239/2499] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:40:30 2021] DELETE /identity/v3/projects/91da5641066242d99b74a660383a26da => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:40:30.950469 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a5653-0a00-4412-9af5-ba483d94c871 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:30.950820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a5653-0a00-4412-9af5-ba483d94c871 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:30.951175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a5653-0a00-4412-9af5-ba483d94c871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:30.971967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-3b0a5653-0a00-4412-9af5-ba483d94c871 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:30.973501 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3b0a5653-0a00-4412-9af5-ba483d94c871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:31.047981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1261/2500] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:31.055944 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8647e71-b4af-4fed-9567-8cdb803d440d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:31.056346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8647e71-b4af-4fed-9567-8cdb803d440d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:31.056703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8647e71-b4af-4fed-9567-8cdb803d440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:31.081267 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e8647e71-b4af-4fed-9567-8cdb803d440d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:31.083184 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e8647e71-b4af-4fed-9567-8cdb803d440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:31.092925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1240/2501] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:31.097102 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a5653-0a00-4412-9af5-ba483d94c871 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:31.116623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a5653-0a00-4412-9af5-ba483d94c871 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:31.122390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b008ea0-2600-4101-8fb4-d67a6f1c13e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:31.123320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008ea0-2600-4101-8fb4-d67a6f1c13e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:31.123754 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008ea0-2600-4101-8fb4-d67a6f1c13e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:31.124322 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008ea0-2600-4101-8fb4-d67a6f1c13e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:31.125442 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b008ea0-2600-4101-8fb4-d67a6f1c13e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:40:31.125946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b008ea0-2600-4101-8fb4-d67a6f1c13e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:31.127742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b008ea0-2600-4101-8fb4-d67a6f1c13e2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:31.141723 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1262/2502] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:40:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:40:31.145708 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8647e71-b4af-4fed-9567-8cdb803d440d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:31.160357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8647e71-b4af-4fed-9567-8cdb803d440d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:31.166547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb660fb-c1e7-49f4-9f3e-8be68528b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:31.167974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb660fb-c1e7-49f4-9f3e-8be68528b452 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:31.168255 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb660fb-c1e7-49f4-9f3e-8be68528b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:31.168532 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb660fb-c1e7-49f4-9f3e-8be68528b452 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:31.169315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb660fb-c1e7-49f4-9f3e-8be68528b452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:31.171439 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb660fb-c1e7-49f4-9f3e-8be68528b452 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:31.208084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1241/2503] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:40:31 2021] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:40:31.212278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b008ea0-2600-4101-8fb4-d67a6f1c13e2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:31.223613 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b008ea0-2600-4101-8fb4-d67a6f1c13e2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:31.295663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b74474-59d9-44a3-b93b-b0355fdc0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:31.296669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b74474-59d9-44a3-b93b-b0355fdc0732 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:31.297140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b74474-59d9-44a3-b93b-b0355fdc0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:31.297630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b74474-59d9-44a3-b93b-b0355fdc0732 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:31.298556 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b74474-59d9-44a3-b93b-b0355fdc0732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:31.300746 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b74474-59d9-44a3-b93b-b0355fdc0732 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:31.323027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1263/2504] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:40:31 2021] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:40:31.327170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb660fb-c1e7-49f4-9f3e-8be68528b452 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:31.341870 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb660fb-c1e7-49f4-9f3e-8be68528b452 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:31.348405 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70612e4a-2307-42da-8f08-5e79a5a66661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:31.349584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70612e4a-2307-42da-8f08-5e79a5a66661 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:31.350227 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70612e4a-2307-42da-8f08-5e79a5a66661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:31.351959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70612e4a-2307-42da-8f08-5e79a5a66661 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:31.352968 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70612e4a-2307-42da-8f08-5e79a5a66661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:31.355424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70612e4a-2307-42da-8f08-5e79a5a66661 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:31.369670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1242/2505] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:40:31 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:40:31.375221 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b74474-59d9-44a3-b93b-b0355fdc0732 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:31.389767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b74474-59d9-44a3-b93b-b0355fdc0732 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:31.395002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d133dd2-2707-4419-aec6-188f55ed1f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:31.395787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d133dd2-2707-4419-aec6-188f55ed1f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:31.396142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d133dd2-2707-4419-aec6-188f55ed1f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:31.396492 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d133dd2-2707-4419-aec6-188f55ed1f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:31.397320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d133dd2-2707-4419-aec6-188f55ed1f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:31.399137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d133dd2-2707-4419-aec6-188f55ed1f1a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:31.411508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1264/2506] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:40:31 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:40:31.415708 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70612e4a-2307-42da-8f08-5e79a5a66661 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:31.427070 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70612e4a-2307-42da-8f08-5e79a5a66661 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:31.432071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dd502-292d-4ec7-8659-e14f916adb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:31.433372 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dd502-292d-4ec7-8659-e14f916adb7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:31.433372 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dd502-292d-4ec7-8659-e14f916adb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:31.433586 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dd502-292d-4ec7-8659-e14f916adb7f admin admin] PATH_INFO: `/v3/projects/10799d1b1db34e69a6c6bba276744b0f/users/4c98a5d1c09e43c99bcbc1e9785d1edd/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:31.462643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dd502-292d-4ec7-8659-e14f916adb7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10799d1b1db34e69a6c6bba276744b0f, user_id=4c98a5d1c09e43c99bcbc1e9785d1edd, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:31.466058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dd502-292d-4ec7-8659-e14f916adb7f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:31.489307 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1243/2507] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:40:31 2021] PUT /identity/v3/projects/10799d1b1db34e69a6c6bba276744b0f/users/4c98a5d1c09e43c99bcbc1e9785d1edd/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:40:31.494245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd68b8a-73c8-4286-a0a1-be7aa4e49a70 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:31.494534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd68b8a-73c8-4286-a0a1-be7aa4e49a70 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:31.494812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd68b8a-73c8-4286-a0a1-be7aa4e49a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:31.514277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-4fd68b8a-73c8-4286-a0a1-be7aa4e49a70 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:31.515498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4fd68b8a-73c8-4286-a0a1-be7aa4e49a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:31.612127 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1265/2508] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:31.622852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dd502-292d-4ec7-8659-e14f916adb7f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:31.624616 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-de6dd502-292d-4ec7-8659-e14f916adb7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:31.693620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dd502-292d-4ec7-8659-e14f916adb7f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:31.699618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c603e8c-9360-4067-82af-811bf118618f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:31.700291 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c603e8c-9360-4067-82af-811bf118618f service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:31.700584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c603e8c-9360-4067-82af-811bf118618f service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:31.701080 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c603e8c-9360-4067-82af-811bf118618f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:31.712851 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c603e8c-9360-4067-82af-811bf118618f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:31.715101 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c603e8c-9360-4067-82af-811bf118618f service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:31.737843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1244/2509] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:40:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:40:34.575650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a1d1-adc1-439f-8553-e2f35fe597a3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:34.576230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a1d1-adc1-439f-8553-e2f35fe597a3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:34.576230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a1d1-adc1-439f-8553-e2f35fe597a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:34.599187 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-1a84a1d1-adc1-439f-8553-e2f35fe597a3 None None] MFA Rules not processed for user `825dcf92d1b64c3d8a6c3e41cec2c836`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:34.600477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1a84a1d1-adc1-439f-8553-e2f35fe597a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:34.682691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1266/2510] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:34 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:37.740922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8870-dd06-4621-8652-50df64e86afc None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:37.741558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8870-dd06-4621-8652-50df64e86afc None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:37.741558 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8870-dd06-4621-8652-50df64e86afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:37.777025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-02ca8870-dd06-4621-8652-50df64e86afc None None] MFA Rules not processed for user `4c98a5d1c09e43c99bcbc1e9785d1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:37.778644 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-02ca8870-dd06-4621-8652-50df64e86afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:37.904561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1245/2511] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:37.916648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a1d1-adc1-439f-8553-e2f35fe597a3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:37.919346 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1a84a1d1-adc1-439f-8553-e2f35fe597a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:38.102905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a1d1-adc1-439f-8553-e2f35fe597a3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:38.116626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868978c-5764-47d2-b85a-60c7550da7c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:38.117611 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868978c-5764-47d2-b85a-60c7550da7c7 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:38.118015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868978c-5764-47d2-b85a-60c7550da7c7 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:38.118362 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868978c-5764-47d2-b85a-60c7550da7c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:38.129777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868978c-5764-47d2-b85a-60c7550da7c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:38.132113 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868978c-5764-47d2-b85a-60c7550da7c7 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:38.163569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1267/2512] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:40:37 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:40:40.046840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32500a-c764-4209-a995-d49a8008bfc1 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:40.047380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32500a-c764-4209-a995-d49a8008bfc1 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:40.047380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32500a-c764-4209-a995-d49a8008bfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:40.069142 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-5d32500a-c764-4209-a995-d49a8008bfc1 None None] MFA Rules not processed for user `4c98a5d1c09e43c99bcbc1e9785d1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:40:40.071664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-5d32500a-c764-4209-a995-d49a8008bfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:40.079283 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1246/2513] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:40:40 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:40:41.432343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868978c-5764-47d2-b85a-60c7550da7c7 service nova] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:40:41.446484 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868978c-5764-47d2-b85a-60c7550da7c7 service nova] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:40:41.452471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b86962-ec3d-46d6-bbb6-87ebd1f8a1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:40:41.454074 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b86962-ec3d-46d6-bbb6-87ebd1f8a1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:40:41.454677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b86962-ec3d-46d6-bbb6-87ebd1f8a1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:40:41.455306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b86962-ec3d-46d6-bbb6-87ebd1f8a1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:40:41.459119 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-32b86962-ec3d-46d6-bbb6-87ebd1f8a1c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:40:41.535045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b86962-ec3d-46d6-bbb6-87ebd1f8a1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:40:41.536537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b86962-ec3d-46d6-bbb6-87ebd1f8a1c8 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:40:41.550639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1268/2514] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:40:41 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:24.201705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70b01e-37db-4dbf-8550-bf44524e7b23 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:24.202300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70b01e-37db-4dbf-8550-bf44524e7b23 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:24.202300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70b01e-37db-4dbf-8550-bf44524e7b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:24.219822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-ef70b01e-37db-4dbf-8550-bf44524e7b23 None None] MFA Rules not processed for user `7e3a3afdfc4c44a29d0f3df50a5ed2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:24.220995 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ef70b01e-37db-4dbf-8550-bf44524e7b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:24.273404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1247/2515] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:41:24 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:27.253399 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b86962-ec3d-46d6-bbb6-87ebd1f8a1c8 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:27.255538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-32b86962-ec3d-46d6-bbb6-87ebd1f8a1c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:27.267463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b86962-ec3d-46d6-bbb6-87ebd1f8a1c8 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:27.272029 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58aa6-9d0d-4c50-a46e-d9fb3fd7b6db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:27.272785 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58aa6-9d0d-4c50-a46e-d9fb3fd7b6db service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:27.273141 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58aa6-9d0d-4c50-a46e-d9fb3fd7b6db service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:27.273488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58aa6-9d0d-4c50-a46e-d9fb3fd7b6db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:27.275553 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3fc58aa6-9d0d-4c50-a46e-d9fb3fd7b6db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:27.291630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc58aa6-9d0d-4c50-a46e-d9fb3fd7b6db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:27.293176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc58aa6-9d0d-4c50-a46e-d9fb3fd7b6db service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:27.307252 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1269/2516] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:27 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:41:28.655474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70b01e-37db-4dbf-8550-bf44524e7b23 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:28.665665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70b01e-37db-4dbf-8550-bf44524e7b23 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:28.671358 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9d983-a85e-41d2-b80b-50b665033c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:28.672483 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9d983-a85e-41d2-b80b-50b665033c72 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:28.672849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9d983-a85e-41d2-b80b-50b665033c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:28.673121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9d983-a85e-41d2-b80b-50b665033c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:28.674897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-dda9d983-a85e-41d2-b80b-50b665033c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:28.688911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9d983-a85e-41d2-b80b-50b665033c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:28.690361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9d983-a85e-41d2-b80b-50b665033c72 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:28.701070 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1248/2517] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:28 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:32.751576 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58aa6-9d0d-4c50-a46e-d9fb3fd7b6db service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:32.753009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-3fc58aa6-9d0d-4c50-a46e-d9fb3fd7b6db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:32.806710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58aa6-9d0d-4c50-a46e-d9fb3fd7b6db service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:32.810332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd3c62-4e4b-41bc-909f-7253a7594a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:32.810908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd3c62-4e4b-41bc-909f-7253a7594a12 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:32.811185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd3c62-4e4b-41bc-909f-7253a7594a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:32.811459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd3c62-4e4b-41bc-909f-7253a7594a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:32.813204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-87cd3c62-4e4b-41bc-909f-7253a7594a12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:32.823588 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd3c62-4e4b-41bc-909f-7253a7594a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:32.824984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd3c62-4e4b-41bc-909f-7253a7594a12 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:32.833646 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1270/2518] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:32 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:43.946119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9d983-a85e-41d2-b80b-50b665033c72 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:43.959268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9d983-a85e-41d2-b80b-50b665033c72 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:43.964106 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4af253-8ac0-4951-8c46-df259dedd137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:43.964768 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4af253-8ac0-4951-8c46-df259dedd137 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:43.965051 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4af253-8ac0-4951-8c46-df259dedd137 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:43.965322 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4af253-8ac0-4951-8c46-df259dedd137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:43.967848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-6d4af253-8ac0-4951-8c46-df259dedd137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:43.985060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4af253-8ac0-4951-8c46-df259dedd137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:43.988000 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4af253-8ac0-4951-8c46-df259dedd137 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:44.004984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1249/2519] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:41:43 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:41:52.246857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e60503-25f9-45de-ad2f-c6e80fed5dc9 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:52.247426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e60503-25f9-45de-ad2f-c6e80fed5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:52.247426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e60503-25f9-45de-ad2f-c6e80fed5dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:52.265500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-86e60503-25f9-45de-ad2f-c6e80fed5dc9 None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:41:52.266644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-86e60503-25f9-45de-ad2f-c6e80fed5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:52.320505 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1271/2520] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:41:52 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:41:52.363398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4af253-8ac0-4951-8c46-df259dedd137 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:41:52.364849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-6d4af253-8ac0-4951-8c46-df259dedd137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:41:52.437645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4af253-8ac0-4951-8c46-df259dedd137 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:41:52.443216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd72e8-039f-437d-a9ca-7101a16048c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:41:52.444404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd72e8-039f-437d-a9ca-7101a16048c4 service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:41:52.444906 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd72e8-039f-437d-a9ca-7101a16048c4 service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:41:52.445405 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd72e8-039f-437d-a9ca-7101a16048c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:41:52.458966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd72e8-039f-437d-a9ca-7101a16048c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:41:52.460660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd72e8-039f-437d-a9ca-7101a16048c4 service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:41:52.470852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1250/2521] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:41:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:42:05.638660 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e60503-25f9-45de-ad2f-c6e80fed5dc9 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:05.640875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-86e60503-25f9-45de-ad2f-c6e80fed5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:05.657940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e60503-25f9-45de-ad2f-c6e80fed5dc9 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:05.664813 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba783ae1-dbb2-446f-8c6d-d14986a3717d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:05.665489 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783ae1-dbb2-446f-8c6d-d14986a3717d service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:05.665796 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783ae1-dbb2-446f-8c6d-d14986a3717d service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:05.666066 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783ae1-dbb2-446f-8c6d-d14986a3717d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:05.667964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ba783ae1-dbb2-446f-8c6d-d14986a3717d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:05.682713 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba783ae1-dbb2-446f-8c6d-d14986a3717d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:05.684320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba783ae1-dbb2-446f-8c6d-d14986a3717d service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:05.696829 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1272/2522] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:05 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:06.731386 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b6b6-6b7c-4f60-b270-a76fe8e5ac22 None None] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:06.732057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b6b6-6b7c-4f60-b270-a76fe8e5ac22 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:06.732057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b6b6-6b7c-4f60-b270-a76fe8e5ac22 None None] PATH_INFO: `/` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:06.733920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1251/2523] 10.222.0.83 () {54 vars in 921 bytes} [Wed Dec 15 13:42:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:42:06.740279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e64c-1d53-4d33-bad1-b21e1db44ed4 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:06.740716 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e64c-1d53-4d33-bad1-b21e1db44ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:06.740863 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e64c-1d53-4d33-bad1-b21e1db44ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:06.779601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-9b25e64c-1d53-4d33-bad1-b21e1db44ed4 None None] MFA Rules not processed for user `a34b3d2f67b1477598acce389819c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:06.780844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9b25e64c-1d53-4d33-bad1-b21e1db44ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:06.790324 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1273/2524] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Dec 15 13:42:06 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:06.802800 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b6b6-6b7c-4f60-b270-a76fe8e5ac22 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:06.804666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8611b6b6-6b7c-4f60-b270-a76fe8e5ac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:06.886522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b6b6-6b7c-4f60-b270-a76fe8e5ac22 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:06.891135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181125c-f8f7-449e-9974-a8278b9c1c5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ddafedf2734326832ab4bf620f7634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:06.891786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181125c-f8f7-449e-9974-a8278b9c1c5a service glance] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:06.892073 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181125c-f8f7-449e-9974-a8278b9c1c5a service glance] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:06.892351 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181125c-f8f7-449e-9974-a8278b9c1c5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:06.902617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181125c-f8f7-449e-9974-a8278b9c1c5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:06.904046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181125c-f8f7-449e-9974-a8278b9c1c5a service glance] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:06.915020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1252/2525] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:06 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:42:06.992096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c7d9-d5f4-43b8-be8f-80eb6a16ca87 None None] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:06.992307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c7d9-d5f4-43b8-be8f-80eb6a16ca87 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:06.992552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c7d9-d5f4-43b8-be8f-80eb6a16ca87 None None] PATH_INFO: `/` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:06.994339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1274/2526] 10.222.0.83 () {54 vars in 921 bytes} [Wed Dec 15 13:42:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:42:07.000194 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ac70f-e057-4ea6-b3ce-d84332548054 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:07.000655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ac70f-e057-4ea6-b3ce-d84332548054 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:07.000845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ac70f-e057-4ea6-b3ce-d84332548054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:07.019971 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-bb6ac70f-e057-4ea6-b3ce-d84332548054 None None] MFA Rules not processed for user `de1632f6a5414d2abfdee3b5bdd941cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:07.021170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-bb6ac70f-e057-4ea6-b3ce-d84332548054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:07.027989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1253/2527] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Dec 15 13:42:06 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:07.040777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9c7d9-d5f4-43b8-be8f-80eb6a16ca87 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:07.052207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9c7d9-d5f4-43b8-be8f-80eb6a16ca87 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:07.055746 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7801e-44e5-49ae-8722-3a0417bbc49f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:07.056376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7801e-44e5-49ae-8722-3a0417bbc49f service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:07.056658 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7801e-44e5-49ae-8722-3a0417bbc49f service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:07.056947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7801e-44e5-49ae-8722-3a0417bbc49f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:07.064751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7801e-44e5-49ae-8722-3a0417bbc49f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:07.066212 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7801e-44e5-49ae-8722-3a0417bbc49f service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:07.073919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1275/2528] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:07 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:07.165123 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ac70f-e057-4ea6-b3ce-d84332548054 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:07.166549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-bb6ac70f-e057-4ea6-b3ce-d84332548054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:07.234497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ac70f-e057-4ea6-b3ce-d84332548054 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:07.239677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a542ff-7ac8-476a-ada7-6d84e1a9f297 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b1d42ac3a427bb084740a069b577d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:07.240319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a542ff-7ac8-476a-ada7-6d84e1a9f297 service placement] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:07.240596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a542ff-7ac8-476a-ada7-6d84e1a9f297 service placement] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:07.240868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a542ff-7ac8-476a-ada7-6d84e1a9f297 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:07.242700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-97a542ff-7ac8-476a-ada7-6d84e1a9f297 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:07.254606 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a542ff-7ac8-476a-ada7-6d84e1a9f297 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:07.256161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a542ff-7ac8-476a-ada7-6d84e1a9f297 service placement] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:07.265942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1254/2529] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:07 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:08.889044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98ac5b-a3e3-467c-8f1b-e0dbbe4acae0 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.889524 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98ac5b-a3e3-467c-8f1b-e0dbbe4acae0 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.889627 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98ac5b-a3e3-467c-8f1b-e0dbbe4acae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.907817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-4b98ac5b-a3e3-467c-8f1b-e0dbbe4acae0 None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:08.909015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4b98ac5b-a3e3-467c-8f1b-e0dbbe4acae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:08.916188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1276/2530] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Dec 15 13:42:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:08.946019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a542ff-7ac8-476a-ada7-6d84e1a9f297 service placement] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:08.957353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a542ff-7ac8-476a-ada7-6d84e1a9f297 service placement] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:08.962302 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b93a58-2d03-4bc8-9f03-4bb7f731a7d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:08.963195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b93a58-2d03-4bc8-9f03-4bb7f731a7d6 service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:08.963472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b93a58-2d03-4bc8-9f03-4bb7f731a7d6 service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:08.963748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b93a58-2d03-4bc8-9f03-4bb7f731a7d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:08.972253 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b93a58-2d03-4bc8-9f03-4bb7f731a7d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:08.973764 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b93a58-2d03-4bc8-9f03-4bb7f731a7d6 service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:08.981947 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1255/2531] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:42:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:42:26.032144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98ac5b-a3e3-467c-8f1b-e0dbbe4acae0 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:26.050941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98ac5b-a3e3-467c-8f1b-e0dbbe4acae0 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:26.070721 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d94ea-2f3a-49ff-b6ce-ed6b8f1c2f25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:26.071461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d94ea-2f3a-49ff-b6ce-ed6b8f1c2f25 service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:26.071752 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d94ea-2f3a-49ff-b6ce-ed6b8f1c2f25 service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:26.072025 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d94ea-2f3a-49ff-b6ce-ed6b8f1c2f25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:26.074037 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-060d94ea-2f3a-49ff-b6ce-ed6b8f1c2f25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:26.110136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d94ea-2f3a-49ff-b6ce-ed6b8f1c2f25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:26.113522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d94ea-2f3a-49ff-b6ce-ed6b8f1c2f25 service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:26.144563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1277/2532] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:27.549175 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89719c74-4cda-4e29-865f-a04cb0b368a4 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:27.549730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89719c74-4cda-4e29-865f-a04cb0b368a4 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:27.549858 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89719c74-4cda-4e29-865f-a04cb0b368a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:27.582922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-89719c74-4cda-4e29-865f-a04cb0b368a4 None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:27.584178 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-89719c74-4cda-4e29-865f-a04cb0b368a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:27.598889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1256/2533] 10.222.0.83 () {58 vars in 967 bytes} [Wed Dec 15 13:42:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:27.619010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d94ea-2f3a-49ff-b6ce-ed6b8f1c2f25 service nova] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:27.636208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d94ea-2f3a-49ff-b6ce-ed6b8f1c2f25 service nova] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:27.643101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf7699-eaa7-4833-8140-cf9133e2d2d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:27.644430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7699-eaa7-4833-8140-cf9133e2d2d0 service swift] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:27.644430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7699-eaa7-4833-8140-cf9133e2d2d0 service swift] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:27.644640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7699-eaa7-4833-8140-cf9133e2d2d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:27.657369 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf7699-eaa7-4833-8140-cf9133e2d2d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:27.658940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf7699-eaa7-4833-8140-cf9133e2d2d0 service swift] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:27.668373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1278/2534] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:42:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:42:32.769511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89719c74-4cda-4e29-865f-a04cb0b368a4 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:32.785305 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89719c74-4cda-4e29-865f-a04cb0b368a4 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:32.792317 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3c0bc-98a7-4f9c-9450-cdf9c4b02d0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:32.793054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3c0bc-98a7-4f9c-9450-cdf9c4b02d0a service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:32.793409 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3c0bc-98a7-4f9c-9450-cdf9c4b02d0a service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:32.793748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3c0bc-98a7-4f9c-9450-cdf9c4b02d0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:32.796369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9cc3c0bc-98a7-4f9c-9450-cdf9c4b02d0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:32.809438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3c0bc-98a7-4f9c-9450-cdf9c4b02d0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:32.811702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3c0bc-98a7-4f9c-9450-cdf9c4b02d0a service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:32.822693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1257/2535] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:42:33.900439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f5604-faab-4a52-ab7d-458d204b67ed None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:33.900904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f5604-faab-4a52-ab7d-458d204b67ed None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:33.901043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f5604-faab-4a52-ab7d-458d204b67ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:33.919342 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-801f5604-faab-4a52-ab7d-458d204b67ed None None] MFA Rules not processed for user `126a2ccd1b86445480efa0468d96960a`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:42:33.921121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-801f5604-faab-4a52-ab7d-458d204b67ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:33.928306 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1279/2536] 10.222.0.83 () {58 vars in 967 bytes} [Wed Dec 15 13:42:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:42:33.941324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3c0bc-98a7-4f9c-9450-cdf9c4b02d0a service nova] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:33.952362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3c0bc-98a7-4f9c-9450-cdf9c4b02d0a service nova] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:33.957783 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5af29-aedd-489a-bc3a-522e42224e82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ec8ea8a0904d30b6a95c8ebc9dd634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:33.958641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5af29-aedd-489a-bc3a-522e42224e82 service swift] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:33.959071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5af29-aedd-489a-bc3a-522e42224e82 service swift] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:33.959544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5af29-aedd-489a-bc3a-522e42224e82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:33.972773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5af29-aedd-489a-bc3a-522e42224e82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:33.974404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5af29-aedd-489a-bc3a-522e42224e82 service swift] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:33.983902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1258/2537] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Dec 15 13:42:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:42:35.128283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f5604-faab-4a52-ab7d-458d204b67ed None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:35.138008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f5604-faab-4a52-ab7d-458d204b67ed None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:35.142488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04aaee-87e5-4a66-ac70-45c57edd7b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:35.143301 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04aaee-87e5-4a66-ac70-45c57edd7b07 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:35.143654 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04aaee-87e5-4a66-ac70-45c57edd7b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:35.143935 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04aaee-87e5-4a66-ac70-45c57edd7b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:35.145909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2e04aaee-87e5-4a66-ac70-45c57edd7b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:35.156099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04aaee-87e5-4a66-ac70-45c57edd7b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:35.157565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04aaee-87e5-4a66-ac70-45c57edd7b07 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:35.166428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1280/2538] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:42:35 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:42:41.913357 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5af29-aedd-489a-bc3a-522e42224e82 service swift] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:41.914854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ebe5af29-aedd-489a-bc3a-522e42224e82 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:41.939930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5af29-aedd-489a-bc3a-522e42224e82 service swift] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:41.948416 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:41.949367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:41.949649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:41.949952 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] PATH_INFO: `/v3/users/01a989a159d14d8099e2f9b5ee46f1f9` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:41.955269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a989a159d14d8099e2f9b5ee46f1f9)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:41.957424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:42.011957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a989a159d14d8099e2f9b5ee46f1f9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.018814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a989a159d14d8099e2f9b5ee46f1f9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.027443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a989a159d14d8099e2f9b5ee46f1f9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.040018 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a989a159d14d8099e2f9b5ee46f1f9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.040713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a989a159d14d8099e2f9b5ee46f1f9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.047875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1259/2539] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:41 2021] DELETE /identity/v3/users/01a989a159d14d8099e2f9b5ee46f1f9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:42.230996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04aaee-87e5-4a66-ac70-45c57edd7b07 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:42.246497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04aaee-87e5-4a66-ac70-45c57edd7b07 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:42.316779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:42.318381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:42.318668 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:42.318946 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] PATH_INFO: `/v3/projects/56ce01ca50734f87ad8566b49ea5292a` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:42.320276 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ce01ca50734f87ad8566b49ea5292a)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:42.322309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:42.382739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ce01ca50734f87ad8566b49ea5292a', 'request_id': 'req-42c60099-09b6-4ead-8b66-54b75492d112'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.390108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ce01ca50734f87ad8566b49ea5292a', 'request_id': 'req-42c60099-09b6-4ead-8b66-54b75492d112'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.397987 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ce01ca50734f87ad8566b49ea5292a', 'request_id': 'req-42c60099-09b6-4ead-8b66-54b75492d112'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.409295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] The token cache is being invalidate because project 56ce01ca50734f87ad8566b49ea5292a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:42.409579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.410264 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.411823 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1281/2540] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:42 2021] DELETE /identity/v3/projects/56ce01ca50734f87ad8566b49ea5292a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:42.416082 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:42.417567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:42.431603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19032a27-ed4b-49d8-b1d8-9916f49ba0e7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:42.489084 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:42.490001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:42.490299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:42.490555 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] PATH_INFO: `/v3/users/65e6b6dd43634a759e3be43424561d5e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:42.491940 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e6b6dd43634a759e3be43424561d5e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:42.493883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:42.540492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e6b6dd43634a759e3be43424561d5e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.546993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e6b6dd43634a759e3be43424561d5e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.554062 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e6b6dd43634a759e3be43424561d5e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.565317 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e6b6dd43634a759e3be43424561d5e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.566025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e6b6dd43634a759e3be43424561d5e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.571711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1260/2541] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:42:42 2021] DELETE /identity/v3/users/65e6b6dd43634a759e3be43424561d5e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:42:42.739676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:42:42.741546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:42:42.765114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c60099-09b6-4ead-8b66-54b75492d112 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:42:42.823385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:42:42.824274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:42:42.824550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:42:42.826194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] PATH_INFO: `/v3/projects/e7cbbb43ec734d67bf4f796e58f5a8ff` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:42:42.828098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7cbbb43ec734d67bf4f796e58f5a8ff)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:42:42.830248 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:42:42.878469 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7cbbb43ec734d67bf4f796e58f5a8ff', 'request_id': 'req-ce5203f8-07f7-4edb-b78f-814c75835150'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.885406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7cbbb43ec734d67bf4f796e58f5a8ff', 'request_id': 'req-ce5203f8-07f7-4edb-b78f-814c75835150'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.894050 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7cbbb43ec734d67bf4f796e58f5a8ff', 'request_id': 'req-ce5203f8-07f7-4edb-b78f-814c75835150'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.906316 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] The token cache is being invalidate because project e7cbbb43ec734d67bf4f796e58f5a8ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:42:42.906605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.907237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:42:42.908773 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1282/2542] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:42:42 2021] DELETE /identity/v3/projects/e7cbbb43ec734d67bf4f796e58f5a8ff => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:14.870110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:14.871530 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:14.934180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc220f-49cc-47d4-9da6-a672c2fcca21 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:14.980397 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff28b4-69c7-460c-be1b-89372754e292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:14.981040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff28b4-69c7-460c-be1b-89372754e292 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:14.981316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff28b4-69c7-460c-be1b-89372754e292 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:14.981588 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff28b4-69c7-460c-be1b-89372754e292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:14.983370 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-55ff28b4-69c7-460c-be1b-89372754e292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:15.043966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff28b4-69c7-460c-be1b-89372754e292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:15.045464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff28b4-69c7-460c-be1b-89372754e292 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:15.055926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1261/2543] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:43:18.247185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:18.248784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:18.261871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5203f8-07f7-4edb-b78f-814c75835150 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:18.267237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e79561-b3e4-4551-8754-08e2831d02a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:18.268139 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e79561-b3e4-4551-8754-08e2831d02a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:18.268418 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e79561-b3e4-4551-8754-08e2831d02a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:18.268695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e79561-b3e4-4551-8754-08e2831d02a0 admin admin] PATH_INFO: `/v3/users/825dcf92d1b64c3d8a6c3e41cec2c836` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:18.269925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e79561-b3e4-4551-8754-08e2831d02a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825dcf92d1b64c3d8a6c3e41cec2c836)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:18.271827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e79561-b3e4-4551-8754-08e2831d02a0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:18.319196 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-06e79561-b3e4-4551-8754-08e2831d02a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825dcf92d1b64c3d8a6c3e41cec2c836'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:18.325917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-06e79561-b3e4-4551-8754-08e2831d02a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825dcf92d1b64c3d8a6c3e41cec2c836'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:18.326650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-06e79561-b3e4-4551-8754-08e2831d02a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825dcf92d1b64c3d8a6c3e41cec2c836'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:18.339372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-06e79561-b3e4-4551-8754-08e2831d02a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825dcf92d1b64c3d8a6c3e41cec2c836'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:18.340186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-06e79561-b3e4-4551-8754-08e2831d02a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825dcf92d1b64c3d8a6c3e41cec2c836'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:18.353947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1283/2544] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:43:18 2021] DELETE /identity/v3/users/825dcf92d1b64c3d8a6c3e41cec2c836 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:43:18.522388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff28b4-69c7-460c-be1b-89372754e292 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:18.533788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff28b4-69c7-460c-be1b-89372754e292 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:18.597746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:18.598628 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:18.598911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:18.599186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] PATH_INFO: `/v3/projects/0bddd6292c044cdb9eb8e5bba5ebd4fc` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:18.600781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bddd6292c044cdb9eb8e5bba5ebd4fc)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:18.603801 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:18.649874 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'request_id': 'req-71f80ae4-b295-4257-a43a-c7ac934a1abf'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:18.657176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'request_id': 'req-71f80ae4-b295-4257-a43a-c7ac934a1abf'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:18.664477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'request_id': 'req-71f80ae4-b295-4257-a43a-c7ac934a1abf'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:18.675204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] The token cache is being invalidate because project 0bddd6292c044cdb9eb8e5bba5ebd4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:43:18.675488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:18.676115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-71f80ae4-b295-4257-a43a-c7ac934a1abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:43:18.677630 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1262/2545] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:43:18 2021] DELETE /identity/v3/projects/0bddd6292c044cdb9eb8e5bba5ebd4fc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:18.683665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1364fcb-e1a1-44bd-887d-eccd6de04dc5 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:18.684061 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1364fcb-e1a1-44bd-887d-eccd6de04dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:18.684483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1364fcb-e1a1-44bd-887d-eccd6de04dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:18.704001 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-c1364fcb-e1a1-44bd-887d-eccd6de04dc5 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:18.705111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c1364fcb-e1a1-44bd-887d-eccd6de04dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:18.762393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1284/2546] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:43:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:18.770361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13b671-56e1-43d2-a018-599ac8fe4842 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:18.770639 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13b671-56e1-43d2-a018-599ac8fe4842 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:18.770923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13b671-56e1-43d2-a018-599ac8fe4842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:18.789212 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-8c13b671-56e1-43d2-a018-599ac8fe4842 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:18.790513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8c13b671-56e1-43d2-a018-599ac8fe4842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:18.799288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1263/2547] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:43:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:18.803482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1364fcb-e1a1-44bd-887d-eccd6de04dc5 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:18.812962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1364fcb-e1a1-44bd-887d-eccd6de04dc5 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:18.817501 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811bb0d-5681-456b-a456-08fd14e50447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:18.818174 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811bb0d-5681-456b-a456-08fd14e50447 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:18.818456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811bb0d-5681-456b-a456-08fd14e50447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:18.818730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811bb0d-5681-456b-a456-08fd14e50447 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:18.819457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811bb0d-5681-456b-a456-08fd14e50447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:43:18.819755 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811bb0d-5681-456b-a456-08fd14e50447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:18.821320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811bb0d-5681-456b-a456-08fd14e50447 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:18.833537 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1285/2548] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:43:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:43:18.837928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13b671-56e1-43d2-a018-599ac8fe4842 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:18.847969 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13b671-56e1-43d2-a018-599ac8fe4842 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:18.852764 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ac53-4b35-484d-b999-026b4ba117c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:18.853414 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ac53-4b35-484d-b999-026b4ba117c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:18.853690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ac53-4b35-484d-b999-026b4ba117c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:18.853995 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ac53-4b35-484d-b999-026b4ba117c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:18.854700 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361ac53-4b35-484d-b999-026b4ba117c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:18.856653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361ac53-4b35-484d-b999-026b4ba117c5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:18.892088 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1264/2549] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:43:18 2021] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:43:18.896153 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811bb0d-5681-456b-a456-08fd14e50447 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:18.906591 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811bb0d-5681-456b-a456-08fd14e50447 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:18.965041 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bbcec-d11f-40a9-8c62-60fc2d61ee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:18.965608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bbcec-d11f-40a9-8c62-60fc2d61ee72 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:18.965923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bbcec-d11f-40a9-8c62-60fc2d61ee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:18.966195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bbcec-d11f-40a9-8c62-60fc2d61ee72 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:18.967170 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bbcec-d11f-40a9-8c62-60fc2d61ee72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:18.969587 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bbcec-d11f-40a9-8c62-60fc2d61ee72 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:19.001003 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1286/2550] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:43:18 2021] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:43:19.005872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ac53-4b35-484d-b999-026b4ba117c5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:19.017431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ac53-4b35-484d-b999-026b4ba117c5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:19.022301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a854b57-19a1-4e8f-84c2-01a57315246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:19.022981 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a854b57-19a1-4e8f-84c2-01a57315246d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:19.023257 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a854b57-19a1-4e8f-84c2-01a57315246d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:19.023526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a854b57-19a1-4e8f-84c2-01a57315246d admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:19.024254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a854b57-19a1-4e8f-84c2-01a57315246d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:19.025866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a854b57-19a1-4e8f-84c2-01a57315246d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:19.036763 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1265/2551] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:43:19 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:43:19.041038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bbcec-d11f-40a9-8c62-60fc2d61ee72 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:19.051967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bbcec-d11f-40a9-8c62-60fc2d61ee72 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:19.056700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625e40b-a940-4035-bf2d-1e7ad24a9800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:19.057360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625e40b-a940-4035-bf2d-1e7ad24a9800 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:19.057663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625e40b-a940-4035-bf2d-1e7ad24a9800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:19.057980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625e40b-a940-4035-bf2d-1e7ad24a9800 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:19.058715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625e40b-a940-4035-bf2d-1e7ad24a9800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:19.060283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625e40b-a940-4035-bf2d-1e7ad24a9800 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:19.070011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1287/2552] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:43:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:43:19.074203 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a854b57-19a1-4e8f-84c2-01a57315246d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:19.084442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a854b57-19a1-4e8f-84c2-01a57315246d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:19.089002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4585b-9e40-4783-850a-e7d968a5d073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:19.089882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4585b-9e40-4783-850a-e7d968a5d073 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:19.090157 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4585b-9e40-4783-850a-e7d968a5d073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:19.090425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4585b-9e40-4783-850a-e7d968a5d073 admin admin] PATH_INFO: `/v3/projects/5d663b994c834c358d7a268a08eac730/users/c5f1e439f9aa45cdbdc0155405423942/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:19.105232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4585b-9e40-4783-850a-e7d968a5d073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d663b994c834c358d7a268a08eac730, user_id=c5f1e439f9aa45cdbdc0155405423942, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:19.107903 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4585b-9e40-4783-850a-e7d968a5d073 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:19.120615 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1266/2553] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:43:19 2021] PUT /identity/v3/projects/5d663b994c834c358d7a268a08eac730/users/c5f1e439f9aa45cdbdc0155405423942/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:43:19.126117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc57c6e-6ed1-4385-889e-6c534d90a588 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:19.126429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc57c6e-6ed1-4385-889e-6c534d90a588 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:19.126709 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc57c6e-6ed1-4385-889e-6c534d90a588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:19.144724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2bc57c6e-6ed1-4385-889e-6c534d90a588 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:19.145951 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2bc57c6e-6ed1-4385-889e-6c534d90a588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:19.203206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1288/2554] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:43:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:19.213132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4585b-9e40-4783-850a-e7d968a5d073 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:19.214878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-23e4585b-9e40-4783-850a-e7d968a5d073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:19.270002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4585b-9e40-4783-850a-e7d968a5d073 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:19.273688 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d9a14-fa30-4874-b8ea-71497942561e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:19.274393 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d9a14-fa30-4874-b8ea-71497942561e service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:19.274706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d9a14-fa30-4874-b8ea-71497942561e service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:19.274978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d9a14-fa30-4874-b8ea-71497942561e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:19.284461 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d9a14-fa30-4874-b8ea-71497942561e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:19.285911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d9a14-fa30-4874-b8ea-71497942561e service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:19.295089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1267/2555] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:43:19.917129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d32f-ab9d-41b5-a357-13090cd3ac46 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:19.918319 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d32f-ab9d-41b5-a357-13090cd3ac46 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:19.918319 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d32f-ab9d-41b5-a357-13090cd3ac46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:19.950214 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-a139d32f-ab9d-41b5-a357-13090cd3ac46 None None] MFA Rules not processed for user `c5f1e439f9aa45cdbdc0155405423942`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:19.951889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a139d32f-ab9d-41b5-a357-13090cd3ac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:20.024362 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1289/2556] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:43:19 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:20.035140 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32d12e-632f-4a74-a506-2f4ed3af2b4d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:20.035665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32d12e-632f-4a74-a506-2f4ed3af2b4d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:20.035665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32d12e-632f-4a74-a506-2f4ed3af2b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:20.056267 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-ff32d12e-632f-4a74-a506-2f4ed3af2b4d None None] MFA Rules not processed for user `c5f1e439f9aa45cdbdc0155405423942`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:20.057498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-ff32d12e-632f-4a74-a506-2f4ed3af2b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:20.071064 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1268/2557] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:43:20 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:20.085425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d32f-ab9d-41b5-a357-13090cd3ac46 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:20.087463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-a139d32f-ab9d-41b5-a357-13090cd3ac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:20.180076 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d32f-ab9d-41b5-a357-13090cd3ac46 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:20.186363 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b8dd3-7a3e-42e5-af9e-1285097d0f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:20.187016 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b8dd3-7a3e-42e5-af9e-1285097d0f7d service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:20.187328 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b8dd3-7a3e-42e5-af9e-1285097d0f7d service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:20.187601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b8dd3-7a3e-42e5-af9e-1285097d0f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:20.195464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b8dd3-7a3e-42e5-af9e-1285097d0f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:20.197019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b8dd3-7a3e-42e5-af9e-1285097d0f7d service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:20.205710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1290/2558] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:20 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:43:20.434825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32d12e-632f-4a74-a506-2f4ed3af2b4d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:20.444367 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32d12e-632f-4a74-a506-2f4ed3af2b4d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:20.448044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466da53-215e-4e57-9345-9bdadf30bd14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:20.448679 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466da53-215e-4e57-9345-9bdadf30bd14 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:20.448956 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466da53-215e-4e57-9345-9bdadf30bd14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:20.449225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466da53-215e-4e57-9345-9bdadf30bd14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:20.451033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8466da53-215e-4e57-9345-9bdadf30bd14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:20.460911 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466da53-215e-4e57-9345-9bdadf30bd14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:20.462374 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466da53-215e-4e57-9345-9bdadf30bd14 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:20.471012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1269/2559] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:43:35.534463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b8dd3-7a3e-42e5-af9e-1285097d0f7d service nova] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:43:35.536188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9a4b8dd3-7a3e-42e5-af9e-1285097d0f7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:35.597125 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b8dd3-7a3e-42e5-af9e-1285097d0f7d service nova] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:43:35.601019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ea527-bde2-4fe6-b557-ffc0c4e9c224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:43:35.601657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea527-bde2-4fe6-b557-ffc0c4e9c224 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:35.601956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea527-bde2-4fe6-b557-ffc0c4e9c224 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:35.602232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea527-bde2-4fe6-b557-ffc0c4e9c224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:35.604054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b72ea527-bde2-4fe6-b557-ffc0c4e9c224 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:35.666315 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ea527-bde2-4fe6-b557-ffc0c4e9c224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:43:35.667919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ea527-bde2-4fe6-b557-ffc0c4e9c224 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:43:35.677790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1291/2560] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:43:35 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:43:40.303674 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402cdc-498e-4a5a-b6d0-ebf79f0e9134 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:40.304071 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402cdc-498e-4a5a-b6d0-ebf79f0e9134 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:40.304273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402cdc-498e-4a5a-b6d0-ebf79f0e9134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:40.322234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-2c402cdc-498e-4a5a-b6d0-ebf79f0e9134 None None] MFA Rules not processed for user `c5f1e439f9aa45cdbdc0155405423942`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:40.323399 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2c402cdc-498e-4a5a-b6d0-ebf79f0e9134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:40.333630 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1270/2561] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:43:40 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:42.515195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae381d-6943-44be-99f3-cc45e5bfce84 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:42.515672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae381d-6943-44be-99f3-cc45e5bfce84 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:42.515797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae381d-6943-44be-99f3-cc45e5bfce84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:42.534592 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-0bae381d-6943-44be-99f3-cc45e5bfce84 None None] MFA Rules not processed for user `7e3a3afdfc4c44a29d0f3df50a5ed2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:42.535920 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0bae381d-6943-44be-99f3-cc45e5bfce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:42.543770 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1292/2562] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:43:42 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:47.673975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2bf7-c007-4f08-ba7a-db6d10d9494d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:47.674488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2bf7-c007-4f08-ba7a-db6d10d9494d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:47.674602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2bf7-c007-4f08-ba7a-db6d10d9494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:47.691673 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-607b2bf7-c007-4f08-ba7a-db6d10d9494d None None] MFA Rules not processed for user `4c98a5d1c09e43c99bcbc1e9785d1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:47.692867 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-607b2bf7-c007-4f08-ba7a-db6d10d9494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:47.746401 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1271/2563] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:43:47 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:43:52.867500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f575ec3-168c-4d37-b8d3-2179f03ad7d8 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:43:52.868018 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f575ec3-168c-4d37-b8d3-2179f03ad7d8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:43:52.868117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f575ec3-168c-4d37-b8d3-2179f03ad7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:43:52.886204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-7f575ec3-168c-4d37-b8d3-2179f03ad7d8 None None] MFA Rules not processed for user `c5f1e439f9aa45cdbdc0155405423942`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:43:52.887385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7f575ec3-168c-4d37-b8d3-2179f03ad7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:43:52.894130 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1293/2564] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:43:52 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:44:06.612535 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b2bf7-c007-4f08-ba7a-db6d10d9494d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:06.624491 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b2bf7-c007-4f08-ba7a-db6d10d9494d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:06.629785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4060a4a-24b0-4a60-8853-27f9eed99313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:06.629785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4060a4a-24b0-4a60-8853-27f9eed99313 service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:06.632476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4060a4a-24b0-4a60-8853-27f9eed99313 service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:06.632476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4060a4a-24b0-4a60-8853-27f9eed99313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:06.632476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e4060a4a-24b0-4a60-8853-27f9eed99313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:06.712388 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4060a4a-24b0-4a60-8853-27f9eed99313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:06.715786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4060a4a-24b0-4a60-8853-27f9eed99313 service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:06.746451 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1272/2565] 10.222.0.83 () {60 vars in 1396 bytes} [Wed Dec 15 13:44:06 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:44:08.105808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f575ec3-168c-4d37-b8d3-2179f03ad7d8 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:08.107412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7f575ec3-168c-4d37-b8d3-2179f03ad7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:08.121269 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f575ec3-168c-4d37-b8d3-2179f03ad7d8 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:08.125022 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87784ab3-3ec4-4d04-8b88-4583a2c27e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:08.125672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87784ab3-3ec4-4d04-8b88-4583a2c27e1b service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:08.126695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87784ab3-3ec4-4d04-8b88-4583a2c27e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:08.126817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87784ab3-3ec4-4d04-8b88-4583a2c27e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:08.128517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-87784ab3-3ec4-4d04-8b88-4583a2c27e1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:08.140781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87784ab3-3ec4-4d04-8b88-4583a2c27e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:08.142796 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87784ab3-3ec4-4d04-8b88-4583a2c27e1b service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:08.152797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1294/2566] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:44:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:44:14.550313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4060a4a-24b0-4a60-8853-27f9eed99313 service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:14.551763 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e4060a4a-24b0-4a60-8853-27f9eed99313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:14.581581 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4060a4a-24b0-4a60-8853-27f9eed99313 service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:14.587152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:14.588174 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:14.588523 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:14.588863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] PATH_INFO: `/v3/users/8fa045c5aa324b8a8e3f3d83437c706d` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:14.590362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fa045c5aa324b8a8e3f3d83437c706d)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:14.592638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:14.658905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa045c5aa324b8a8e3f3d83437c706d'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:14.665690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa045c5aa324b8a8e3f3d83437c706d'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:14.672950 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa045c5aa324b8a8e3f3d83437c706d'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:14.685404 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa045c5aa324b8a8e3f3d83437c706d'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:14.689723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa045c5aa324b8a8e3f3d83437c706d'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:14.695152 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1273/2567] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:44:14 2021] DELETE /identity/v3/users/8fa045c5aa324b8a8e3f3d83437c706d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:14.869463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87784ab3-3ec4-4d04-8b88-4583a2c27e1b service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:14.880195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87784ab3-3ec4-4d04-8b88-4583a2c27e1b service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:14.938237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:14.939540 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:14.939812 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:14.940084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] PATH_INFO: `/v3/projects/ae0b248663174800af3db2a34d92f6b3` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:14.941310 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0b248663174800af3db2a34d92f6b3)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:14.943282 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:14.989295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0b248663174800af3db2a34d92f6b3', 'request_id': 'req-5cebc0ef-7466-4859-a549-c9fda361f41e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:14.995338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0b248663174800af3db2a34d92f6b3', 'request_id': 'req-5cebc0ef-7466-4859-a549-c9fda361f41e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.003606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0b248663174800af3db2a34d92f6b3', 'request_id': 'req-5cebc0ef-7466-4859-a549-c9fda361f41e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.014122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] The token cache is being invalidate because project ae0b248663174800af3db2a34d92f6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:44:15.014404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.015023 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.016550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1295/2568] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:44:14 2021] DELETE /identity/v3/projects/ae0b248663174800af3db2a34d92f6b3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:15.021015 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:15.022433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:15.035244 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea9a82-8046-4db0-8912-b60db882d5fb admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:15.090924 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee623d7-c7e9-49a0-819e-795c38f2d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:15.091788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee623d7-c7e9-49a0-819e-795c38f2d0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:15.092069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee623d7-c7e9-49a0-819e-795c38f2d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:15.092343 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee623d7-c7e9-49a0-819e-795c38f2d0ef admin admin] PATH_INFO: `/v3/users/9886f0663f6645aeade86ec151fe7d7f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:15.093534 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee623d7-c7e9-49a0-819e-795c38f2d0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9886f0663f6645aeade86ec151fe7d7f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:15.095765 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee623d7-c7e9-49a0-819e-795c38f2d0ef admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:15.144202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-dee623d7-c7e9-49a0-819e-795c38f2d0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9886f0663f6645aeade86ec151fe7d7f'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.153004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-dee623d7-c7e9-49a0-819e-795c38f2d0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9886f0663f6645aeade86ec151fe7d7f'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.161646 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-dee623d7-c7e9-49a0-819e-795c38f2d0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9886f0663f6645aeade86ec151fe7d7f'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.173868 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-dee623d7-c7e9-49a0-819e-795c38f2d0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9886f0663f6645aeade86ec151fe7d7f'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.174599 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-dee623d7-c7e9-49a0-819e-795c38f2d0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9886f0663f6645aeade86ec151fe7d7f'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.181474 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1274/2569] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:44:15 2021] DELETE /identity/v3/users/9886f0663f6645aeade86ec151fe7d7f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:15.354811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:15.356314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:15.370092 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebc0ef-7466-4859-a549-c9fda361f41e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:15.431818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:15.432704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:15.432984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:15.433259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] PATH_INFO: `/v3/projects/ec67a4206df348848fed725e5e1049ee` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:15.434463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec67a4206df348848fed725e5e1049ee)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:15.436427 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:15.483926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec67a4206df348848fed725e5e1049ee', 'request_id': 'req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.489913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec67a4206df348848fed725e5e1049ee', 'request_id': 'req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.497094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec67a4206df348848fed725e5e1049ee', 'request_id': 'req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.507004 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] The token cache is being invalidate because project ec67a4206df348848fed725e5e1049ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:44:15.507286 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.507898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:15.509424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1296/2570] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:44:15 2021] DELETE /identity/v3/projects/ec67a4206df348848fed725e5e1049ee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:15.675245 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06924388-dcf3-4020-b92c-3ce7757432d5 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:15.675799 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06924388-dcf3-4020-b92c-3ce7757432d5 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:15.675799 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06924388-dcf3-4020-b92c-3ce7757432d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:15.695044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-06924388-dcf3-4020-b92c-3ce7757432d5 None None] MFA Rules not processed for user `c5f1e439f9aa45cdbdc0155405423942`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:44:15.696306 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-06924388-dcf3-4020-b92c-3ce7757432d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:15.756407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1275/2571] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:44:15 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:44:49.572937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:49.574350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:49.642470 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad1ac4-afc9-40d9-bfaa-162e5b8604d8 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:49.648096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c0a64-9cb4-41f5-a657-ed8bdbeeafb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b1d42ac3a427bb084740a069b577d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:49.648820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c0a64-9cb4-41f5-a657-ed8bdbeeafb4 service placement] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:49.649098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c0a64-9cb4-41f5-a657-ed8bdbeeafb4 service placement] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:49.649372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c0a64-9cb4-41f5-a657-ed8bdbeeafb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:49.651237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-fa9c0a64-9cb4-41f5-a657-ed8bdbeeafb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:49.663907 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c0a64-9cb4-41f5-a657-ed8bdbeeafb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:49.665486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c0a64-9cb4-41f5-a657-ed8bdbeeafb4 service placement] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:49.675871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1297/2572] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:44:49 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:44:56.124431 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06924388-dcf3-4020-b92c-3ce7757432d5 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:56.126271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-06924388-dcf3-4020-b92c-3ce7757432d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:56.199072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06924388-dcf3-4020-b92c-3ce7757432d5 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:56.203989 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bf512-39d2-421b-a2ab-3762281aebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:56.204550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bf512-39d2-421b-a2ab-3762281aebb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:56.204833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bf512-39d2-421b-a2ab-3762281aebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:56.205310 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bf512-39d2-421b-a2ab-3762281aebb8 admin admin] PATH_INFO: `/v3/users/c5f1e439f9aa45cdbdc0155405423942` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:56.206525 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bf512-39d2-421b-a2ab-3762281aebb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f1e439f9aa45cdbdc0155405423942)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:56.209016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bf512-39d2-421b-a2ab-3762281aebb8 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:56.265899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-478bf512-39d2-421b-a2ab-3762281aebb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f1e439f9aa45cdbdc0155405423942'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:56.274332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-478bf512-39d2-421b-a2ab-3762281aebb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f1e439f9aa45cdbdc0155405423942'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:56.287653 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-478bf512-39d2-421b-a2ab-3762281aebb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f1e439f9aa45cdbdc0155405423942'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:56.300217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-478bf512-39d2-421b-a2ab-3762281aebb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f1e439f9aa45cdbdc0155405423942'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:56.300942 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-478bf512-39d2-421b-a2ab-3762281aebb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f1e439f9aa45cdbdc0155405423942'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:56.306938 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1276/2573] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:44:56 2021] DELETE /identity/v3/users/c5f1e439f9aa45cdbdc0155405423942 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:56.484237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c0a64-9cb4-41f5-a657-ed8bdbeeafb4 service placement] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:56.497367 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c0a64-9cb4-41f5-a657-ed8bdbeeafb4 service placement] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:56.558332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:56.559188 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:56.559468 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:56.559772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] PATH_INFO: `/v3/projects/5d663b994c834c358d7a268a08eac730` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:56.560965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d663b994c834c358d7a268a08eac730)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:56.562879 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:56.612143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d663b994c834c358d7a268a08eac730', 'request_id': 'req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:56.618751 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d663b994c834c358d7a268a08eac730', 'request_id': 'req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:56.626027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d663b994c834c358d7a268a08eac730', 'request_id': 'req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:56.637167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] The token cache is being invalidate because project 5d663b994c834c358d7a268a08eac730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:44:56.637456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:56.638110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cda146e4-cd3d-464f-8f07-acab9fa0cb4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:56.639630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1298/2574] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:44:56 2021] DELETE /identity/v3/projects/5d663b994c834c358d7a268a08eac730 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:44:56.645451 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dad2e-4d1a-4e67-adbc-b408b3696644 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:56.645739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dad2e-4d1a-4e67-adbc-b408b3696644 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:56.646257 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dad2e-4d1a-4e67-adbc-b408b3696644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:56.666616 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c86dad2e-4d1a-4e67-adbc-b408b3696644 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:44:56.667756 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c86dad2e-4d1a-4e67-adbc-b408b3696644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:56.725623 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1277/2575] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:44:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:44:56.733419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25134e-2f8a-4d5b-b35b-bef33bc33bbb None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:56.733707 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25134e-2f8a-4d5b-b35b-bef33bc33bbb None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:56.734014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25134e-2f8a-4d5b-b35b-bef33bc33bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:56.752918 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2b25134e-2f8a-4d5b-b35b-bef33bc33bbb None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:44:56.754744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2b25134e-2f8a-4d5b-b35b-bef33bc33bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:56.762870 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1299/2576] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:44:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:44:56.767227 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86dad2e-4d1a-4e67-adbc-b408b3696644 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:56.777875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86dad2e-4d1a-4e67-adbc-b408b3696644 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:56.782624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158db320-c25a-47ae-832d-ae0db9d8350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:56.783265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db320-c25a-47ae-832d-ae0db9d8350f admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:56.783553 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db320-c25a-47ae-832d-ae0db9d8350f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:56.783827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db320-c25a-47ae-832d-ae0db9d8350f admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:56.784592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158db320-c25a-47ae-832d-ae0db9d8350f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:44:56.784897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158db320-c25a-47ae-832d-ae0db9d8350f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:56.786745 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158db320-c25a-47ae-832d-ae0db9d8350f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:56.798545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1278/2577] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:44:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:44:56.803384 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25134e-2f8a-4d5b-b35b-bef33bc33bbb None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:56.812703 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25134e-2f8a-4d5b-b35b-bef33bc33bbb None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:56.818210 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28967cca-7867-495c-958a-f60f11d3c39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:56.818862 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28967cca-7867-495c-958a-f60f11d3c39c admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:56.819144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28967cca-7867-495c-958a-f60f11d3c39c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:56.819419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28967cca-7867-495c-958a-f60f11d3c39c admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:56.820122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28967cca-7867-495c-958a-f60f11d3c39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:56.822047 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28967cca-7867-495c-958a-f60f11d3c39c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:56.847989 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1300/2578] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:44:56 2021] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:44:56.852360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158db320-c25a-47ae-832d-ae0db9d8350f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:56.863926 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158db320-c25a-47ae-832d-ae0db9d8350f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:56.918601 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011115c-8fa9-48b5-bec4-9ab9d7deb2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:56.919180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011115c-8fa9-48b5-bec4-9ab9d7deb2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:56.919463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011115c-8fa9-48b5-bec4-9ab9d7deb2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:56.919735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011115c-8fa9-48b5-bec4-9ab9d7deb2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:56.920433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011115c-8fa9-48b5-bec4-9ab9d7deb2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:56.922378 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011115c-8fa9-48b5-bec4-9ab9d7deb2d7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:56.942186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1279/2579] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:44:56 2021] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:44:56.946256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28967cca-7867-495c-958a-f60f11d3c39c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:56.956458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28967cca-7867-495c-958a-f60f11d3c39c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:56.961157 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd8657-f842-4103-bab0-43f7bcd50f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:56.961841 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd8657-f842-4103-bab0-43f7bcd50f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:56.962128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd8657-f842-4103-bab0-43f7bcd50f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:56.962407 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd8657-f842-4103-bab0-43f7bcd50f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:56.963142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd8657-f842-4103-bab0-43f7bcd50f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:56.964721 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd8657-f842-4103-bab0-43f7bcd50f98 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:56.975561 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1301/2580] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:44:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:44:56.979523 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011115c-8fa9-48b5-bec4-9ab9d7deb2d7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:56.990169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011115c-8fa9-48b5-bec4-9ab9d7deb2d7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:56.995170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bd2e6-75d8-4f96-bbf4-fdc5194ad0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:56.995833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bd2e6-75d8-4f96-bbf4-fdc5194ad0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:56.996112 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bd2e6-75d8-4f96-bbf4-fdc5194ad0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:56.996455 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bd2e6-75d8-4f96-bbf4-fdc5194ad0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:56.997190 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bd2e6-75d8-4f96-bbf4-fdc5194ad0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:56.998817 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bd2e6-75d8-4f96-bbf4-fdc5194ad0e4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:57.008857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1280/2581] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:44:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:44:57.013113 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd8657-f842-4103-bab0-43f7bcd50f98 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:57.022939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd8657-f842-4103-bab0-43f7bcd50f98 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:57.028114 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299415c-67d2-4a53-9d41-43e7c9fedac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:57.029005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299415c-67d2-4a53-9d41-43e7c9fedac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:57.029280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299415c-67d2-4a53-9d41-43e7c9fedac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:57.029552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299415c-67d2-4a53-9d41-43e7c9fedac7 admin admin] PATH_INFO: `/v3/projects/7e4382eab5b04ddcbbdf5348c0e9a7e7/users/5713d0a5b28c44359a5259b62c0a82f3/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:57.046123 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299415c-67d2-4a53-9d41-43e7c9fedac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4382eab5b04ddcbbdf5348c0e9a7e7, user_id=5713d0a5b28c44359a5259b62c0a82f3, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:57.048755 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299415c-67d2-4a53-9d41-43e7c9fedac7 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:57.067644 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1302/2582] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:44:57 2021] PUT /identity/v3/projects/7e4382eab5b04ddcbbdf5348c0e9a7e7/users/5713d0a5b28c44359a5259b62c0a82f3/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:57.077692 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26b8a-d009-46ca-b280-6b33e7c09ee0 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:57.078151 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26b8a-d009-46ca-b280-6b33e7c09ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:57.079260 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26b8a-d009-46ca-b280-6b33e7c09ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:57.106214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c3f26b8a-d009-46ca-b280-6b33e7c09ee0 None None] MFA Rules not processed for user `5713d0a5b28c44359a5259b62c0a82f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:44:57.107437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c3f26b8a-d009-46ca-b280-6b33e7c09ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:57.170638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1281/2583] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:44:57 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:44:57.175329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299415c-67d2-4a53-9d41-43e7c9fedac7 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:57.240052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299415c-67d2-4a53-9d41-43e7c9fedac7 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:57.245020 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2892f-8d8b-4776-aa2b-b72e0d8bba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:57.245698 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2892f-8d8b-4776-aa2b-b72e0d8bba4a admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:57.246006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2892f-8d8b-4776-aa2b-b72e0d8bba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:57.246303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2892f-8d8b-4776-aa2b-b72e0d8bba4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:57.247019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2892f-8d8b-4776-aa2b-b72e0d8bba4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:57.249031 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2892f-8d8b-4776-aa2b-b72e0d8bba4a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:57.282757 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1303/2584] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:44:57 2021] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:44:57.283884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f26b8a-d009-46ca-b280-6b33e7c09ee0 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:57.295671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f26b8a-d009-46ca-b280-6b33e7c09ee0 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:57.356317 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6f931-70a1-4001-8015-f72dbf1509b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:57.357509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6f931-70a1-4001-8015-f72dbf1509b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:57.357822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6f931-70a1-4001-8015-f72dbf1509b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:57.358118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6f931-70a1-4001-8015-f72dbf1509b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:57.358837 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6f931-70a1-4001-8015-f72dbf1509b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:57.360847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6f931-70a1-4001-8015-f72dbf1509b4 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:57.381746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1282/2585] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:44:57 2021] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:44:57.385807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2892f-8d8b-4776-aa2b-b72e0d8bba4a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:57.403341 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2892f-8d8b-4776-aa2b-b72e0d8bba4a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:57.409477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4659c-023a-4a86-aaf8-26f17d9f0e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:57.410742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4659c-023a-4a86-aaf8-26f17d9f0e91 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:57.410999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4659c-023a-4a86-aaf8-26f17d9f0e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:57.411302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4659c-023a-4a86-aaf8-26f17d9f0e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:57.412100 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4659c-023a-4a86-aaf8-26f17d9f0e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:57.413702 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4659c-023a-4a86-aaf8-26f17d9f0e91 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:57.424877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1304/2586] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:44:57 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:44:57.429091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6f931-70a1-4001-8015-f72dbf1509b4 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:57.440108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6f931-70a1-4001-8015-f72dbf1509b4 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:57.444899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cddd8-5561-4613-aee9-4cb04cf18ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:57.445808 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cddd8-5561-4613-aee9-4cb04cf18ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:57.446092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cddd8-5561-4613-aee9-4cb04cf18ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:57.446366 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cddd8-5561-4613-aee9-4cb04cf18ba3 admin admin] PATH_INFO: `/v3/projects/82e4dc9cd3004ee5a4796dd9679167af/users/5ba0cec0f43d4f2c941509d7b32ef6fe/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:57.466041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cddd8-5561-4613-aee9-4cb04cf18ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e4dc9cd3004ee5a4796dd9679167af, user_id=5ba0cec0f43d4f2c941509d7b32ef6fe, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:57.470988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cddd8-5561-4613-aee9-4cb04cf18ba3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:57.487951 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1283/2587] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:44:57 2021] PUT /identity/v3/projects/82e4dc9cd3004ee5a4796dd9679167af/users/5ba0cec0f43d4f2c941509d7b32ef6fe/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:57.493595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4659c-023a-4a86-aaf8-26f17d9f0e91 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:57.503856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4659c-023a-4a86-aaf8-26f17d9f0e91 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:57.573305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f3e98-18b3-4048-83ed-80407c492e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:57.574334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3e98-18b3-4048-83ed-80407c492e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:57.574739 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3e98-18b3-4048-83ed-80407c492e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:57.575036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3e98-18b3-4048-83ed-80407c492e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:57.575642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3e98-18b3-4048-83ed-80407c492e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:57.577194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3e98-18b3-4048-83ed-80407c492e34 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:57.593419 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1305/2588] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:44:57 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:44:57.594659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cddd8-5561-4613-aee9-4cb04cf18ba3 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:57.606691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cddd8-5561-4613-aee9-4cb04cf18ba3 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:57.611872 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded05fd-db0a-4d22-83c8-83db4d39fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:57.612939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded05fd-db0a-4d22-83c8-83db4d39fb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:57.613230 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded05fd-db0a-4d22-83c8-83db4d39fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:57.613724 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded05fd-db0a-4d22-83c8-83db4d39fb04 admin admin] PATH_INFO: `/v3/projects/82e4dc9cd3004ee5a4796dd9679167af/users/5ba0cec0f43d4f2c941509d7b32ef6fe/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:57.615802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded05fd-db0a-4d22-83c8-83db4d39fb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e4dc9cd3004ee5a4796dd9679167af, user_id=5ba0cec0f43d4f2c941509d7b32ef6fe, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:57.618990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded05fd-db0a-4d22-83c8-83db4d39fb04 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:57.630943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1284/2589] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:44:57 2021] PUT /identity/v3/projects/82e4dc9cd3004ee5a4796dd9679167af/users/5ba0cec0f43d4f2c941509d7b32ef6fe/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:57.643615 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6edd1-e848-4a94-8129-b63ce3dc2a06 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:57.644106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6edd1-e848-4a94-8129-b63ce3dc2a06 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:57.645172 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6edd1-e848-4a94-8129-b63ce3dc2a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:57.679186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-91c6edd1-e848-4a94-8129-b63ce3dc2a06 None None] MFA Rules not processed for user `5ba0cec0f43d4f2c941509d7b32ef6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:44:57.680431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-91c6edd1-e848-4a94-8129-b63ce3dc2a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:57.755679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1306/2590] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:44:57 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:44:57.768009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded05fd-db0a-4d22-83c8-83db4d39fb04 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:57.770922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-6ded05fd-db0a-4d22-83c8-83db4d39fb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:57.826095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded05fd-db0a-4d22-83c8-83db4d39fb04 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:57.829727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e6bf8-a8ba-4012-ac7d-9e1578ff892f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:57.830389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e6bf8-a8ba-4012-ac7d-9e1578ff892f service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:57.830665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e6bf8-a8ba-4012-ac7d-9e1578ff892f service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:57.830933 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e6bf8-a8ba-4012-ac7d-9e1578ff892f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:57.840774 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e6bf8-a8ba-4012-ac7d-9e1578ff892f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:57.842236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e6bf8-a8ba-4012-ac7d-9e1578ff892f service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:57.851730 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1285/2591] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:44:57 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:44:58.170259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6edd1-e848-4a94-8129-b63ce3dc2a06 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:58.180729 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6edd1-e848-4a94-8129-b63ce3dc2a06 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:58.185447 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004c8f6-1938-48b6-a73f-6a09f517feff tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba0cec0f43d4f2c941509d7b32ef6fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82e4dc9cd3004ee5a4796dd9679167af', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:58.186135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004c8f6-1938-48b6-a73f-6a09f517feff tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:58.186416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004c8f6-1938-48b6-a73f-6a09f517feff tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:58.186690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004c8f6-1938-48b6-a73f-6a09f517feff tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:58.187423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004c8f6-1938-48b6-a73f-6a09f517feff tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:44:58.187724 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004c8f6-1938-48b6-a73f-6a09f517feff tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:58.189318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004c8f6-1938-48b6-a73f-6a09f517feff tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:58.202028 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1307/2592] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:44:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:44:58.206356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e6bf8-a8ba-4012-ac7d-9e1578ff892f service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:58.215731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e6bf8-a8ba-4012-ac7d-9e1578ff892f service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:58.225931 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c9167-e411-4cab-9b8d-802aa12e1b7d tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba0cec0f43d4f2c941509d7b32ef6fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82e4dc9cd3004ee5a4796dd9679167af', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:58.226600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c9167-e411-4cab-9b8d-802aa12e1b7d tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:58.226892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c9167-e411-4cab-9b8d-802aa12e1b7d tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:58.227171 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c9167-e411-4cab-9b8d-802aa12e1b7d tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:58.227883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c9167-e411-4cab-9b8d-802aa12e1b7d tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:58.229815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c9167-e411-4cab-9b8d-802aa12e1b7d tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:58.258816 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1286/2593] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:44:58 2021] POST /identity/v3/projects => generated 355 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:44:58.263203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004c8f6-1938-48b6-a73f-6a09f517feff tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:58.276718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004c8f6-1938-48b6-a73f-6a09f517feff tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:58.334872 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2a331-7b15-4fc3-80a6-7fc5a1ade4b6 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba0cec0f43d4f2c941509d7b32ef6fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82e4dc9cd3004ee5a4796dd9679167af', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:58.335563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2a331-7b15-4fc3-80a6-7fc5a1ade4b6 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:58.335854 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2a331-7b15-4fc3-80a6-7fc5a1ade4b6 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:58.336137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2a331-7b15-4fc3-80a6-7fc5a1ade4b6 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:58.336871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2a331-7b15-4fc3-80a6-7fc5a1ade4b6 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:44:58.337178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2a331-7b15-4fc3-80a6-7fc5a1ade4b6 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:58.338822 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2a331-7b15-4fc3-80a6-7fc5a1ade4b6 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:58.351054 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1308/2594] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:44:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:44:58.386588 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c9167-e411-4cab-9b8d-802aa12e1b7d tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:58.396943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c9167-e411-4cab-9b8d-802aa12e1b7d tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:58.401856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba0cec0f43d4f2c941509d7b32ef6fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82e4dc9cd3004ee5a4796dd9679167af', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:58.402718 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:58.403000 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:58.403273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] PATH_INFO: `/v3/projects/8096f7f58af644bbb5002a04736120cc` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:58.404467 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8096f7f58af644bbb5002a04736120cc)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:58.406476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:58.454708 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8096f7f58af644bbb5002a04736120cc', 'request_id': 'req-ca261130-5fc7-4933-9d94-a6298e175bc8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:58.461284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8096f7f58af644bbb5002a04736120cc', 'request_id': 'req-ca261130-5fc7-4933-9d94-a6298e175bc8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:58.468466 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8096f7f58af644bbb5002a04736120cc', 'request_id': 'req-ca261130-5fc7-4933-9d94-a6298e175bc8'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:58.479069 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] The token cache is being invalidate because project 8096f7f58af644bbb5002a04736120cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:44:58.479350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:58.480001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-ca261130-5fc7-4933-9d94-a6298e175bc8 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:58.481509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1287/2595] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:44:58 2021] DELETE /identity/v3/projects/8096f7f58af644bbb5002a04736120cc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:58.669098 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2a331-7b15-4fc3-80a6-7fc5a1ade4b6 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:58.670794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4dc2a331-7b15-4fc3-80a6-7fc5a1ade4b6 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:58.737211 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2a331-7b15-4fc3-80a6-7fc5a1ade4b6 tempest-VolumeQuotaClassesTest-1829692531 tempest-VolumeQuotaClassesTest-1829692531-project-admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:58.804984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:58.805878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:58.806161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:58.806436 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] PATH_INFO: `/v3/users/5713d0a5b28c44359a5259b62c0a82f3` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:58.807635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5713d0a5b28c44359a5259b62c0a82f3)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:58.809543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:58.855975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5713d0a5b28c44359a5259b62c0a82f3'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:58.864732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5713d0a5b28c44359a5259b62c0a82f3'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:58.865409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5713d0a5b28c44359a5259b62c0a82f3'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:58.877900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5713d0a5b28c44359a5259b62c0a82f3'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:58.878552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5713d0a5b28c44359a5259b62c0a82f3'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:58.899400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1309/2596] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:44:58 2021] DELETE /identity/v3/users/5713d0a5b28c44359a5259b62c0a82f3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:58.904049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802ea31-91a1-45a9-aa2c-12688f2ba7c3 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:58.904336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802ea31-91a1-45a9-aa2c-12688f2ba7c3 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:58.904612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802ea31-91a1-45a9-aa2c-12688f2ba7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:58.923145 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-9802ea31-91a1-45a9-aa2c-12688f2ba7c3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:44:58.924312 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9802ea31-91a1-45a9-aa2c-12688f2ba7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:58.981919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1288/2597] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:44:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:44:58.992630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:58.994046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:59.051734 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225b793-1e3c-4d77-8c74-7d3d20bcca11 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:59.055509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beed89-2ead-4863-a068-147364a263c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:59.056160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beed89-2ead-4863-a068-147364a263c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:59.056450 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beed89-2ead-4863-a068-147364a263c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:59.056728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beed89-2ead-4863-a068-147364a263c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:59.066033 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beed89-2ead-4863-a068-147364a263c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:59.067444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beed89-2ead-4863-a068-147364a263c2 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:59.077094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1310/2598] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:44:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:44:59.351640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802ea31-91a1-45a9-aa2c-12688f2ba7c3 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:59.353263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9802ea31-91a1-45a9-aa2c-12688f2ba7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:59.366364 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802ea31-91a1-45a9-aa2c-12688f2ba7c3 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:59.371076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:59.371955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:59.372246 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:59.372517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] PATH_INFO: `/v3/projects/7e4382eab5b04ddcbbdf5348c0e9a7e7` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:59.373768 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4382eab5b04ddcbbdf5348c0e9a7e7)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:59.375692 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:59.429378 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4382eab5b04ddcbbdf5348c0e9a7e7', 'request_id': 'req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:59.435689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4382eab5b04ddcbbdf5348c0e9a7e7', 'request_id': 'req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:59.443606 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4382eab5b04ddcbbdf5348c0e9a7e7', 'request_id': 'req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:59.453925 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] The token cache is being invalidate because project 7e4382eab5b04ddcbbdf5348c0e9a7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:44:59.454213 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:59.454842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:59.456403 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1289/2599] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:44:59 2021] DELETE /identity/v3/projects/7e4382eab5b04ddcbbdf5348c0e9a7e7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:44:59.461112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beed89-2ead-4863-a068-147364a263c2 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:59.471161 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beed89-2ead-4863-a068-147364a263c2 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:59.526517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ead08e-95cc-4d17-ac59-887b3fb959d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:59.527317 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ead08e-95cc-4d17-ac59-887b3fb959d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:59.527589 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ead08e-95cc-4d17-ac59-887b3fb959d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:59.527858 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ead08e-95cc-4d17-ac59-887b3fb959d5 admin admin] PATH_INFO: `/v3/users/5ba0cec0f43d4f2c941509d7b32ef6fe` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:59.529088 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ead08e-95cc-4d17-ac59-887b3fb959d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba0cec0f43d4f2c941509d7b32ef6fe)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:59.531037 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ead08e-95cc-4d17-ac59-887b3fb959d5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:44:59.577162 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c8ead08e-95cc-4d17-ac59-887b3fb959d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba0cec0f43d4f2c941509d7b32ef6fe'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:59.583790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c8ead08e-95cc-4d17-ac59-887b3fb959d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba0cec0f43d4f2c941509d7b32ef6fe'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:59.584475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c8ead08e-95cc-4d17-ac59-887b3fb959d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba0cec0f43d4f2c941509d7b32ef6fe'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:59.596111 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c8ead08e-95cc-4d17-ac59-887b3fb959d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba0cec0f43d4f2c941509d7b32ef6fe'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:59.596810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c8ead08e-95cc-4d17-ac59-887b3fb959d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba0cec0f43d4f2c941509d7b32ef6fe'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:44:59.610209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1311/2600] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:44:59 2021] DELETE /identity/v3/users/5ba0cec0f43d4f2c941509d7b32ef6fe => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:44:59.880918 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:44:59.882531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:44:59.896606 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac0fcc-7331-4f6b-9e99-d996bf4f78b9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:44:59.953366 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:44:59.954250 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:44:59.954529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:44:59.954792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] PATH_INFO: `/v3/projects/82e4dc9cd3004ee5a4796dd9679167af` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:44:59.955991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e4dc9cd3004ee5a4796dd9679167af)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:44:59.957894 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.004201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e4dc9cd3004ee5a4796dd9679167af', 'request_id': 'req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:00.010191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e4dc9cd3004ee5a4796dd9679167af', 'request_id': 'req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:00.018122 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e4dc9cd3004ee5a4796dd9679167af', 'request_id': 'req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:00.028119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] The token cache is being invalidate because project 82e4dc9cd3004ee5a4796dd9679167af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:00.028403 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:00.029048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4e3e27de-a61a-4552-b102-ba8bc8a5a37a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:00.030612 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1290/2601] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:44:59 2021] DELETE /identity/v3/projects/82e4dc9cd3004ee5a4796dd9679167af => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:00.036898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5b79-6f8b-47f4-98c1-eafba76c4bb3 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.037399 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5b79-6f8b-47f4-98c1-eafba76c4bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.037513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5b79-6f8b-47f4-98c1-eafba76c4bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.056753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-08fc5b79-6f8b-47f4-98c1-eafba76c4bb3 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:00.058059 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-08fc5b79-6f8b-47f4-98c1-eafba76c4bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:00.116673 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1312/2602] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:00.124546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66444d92-3dbe-499e-a7bd-1fcd18900801 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.124836 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66444d92-3dbe-499e-a7bd-1fcd18900801 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.125117 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66444d92-3dbe-499e-a7bd-1fcd18900801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.144216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-66444d92-3dbe-499e-a7bd-1fcd18900801 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:00.145435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-66444d92-3dbe-499e-a7bd-1fcd18900801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:00.153828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1291/2603] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:00.158229 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc5b79-6f8b-47f4-98c1-eafba76c4bb3 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:00.168807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc5b79-6f8b-47f4-98c1-eafba76c4bb3 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:00.173372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b76d5b-3e67-41b0-9875-de5578e9d504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:00.174063 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b76d5b-3e67-41b0-9875-de5578e9d504 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.174335 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b76d5b-3e67-41b0-9875-de5578e9d504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.174605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b76d5b-3e67-41b0-9875-de5578e9d504 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.175393 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b76d5b-3e67-41b0-9875-de5578e9d504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:45:00.176207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b76d5b-3e67-41b0-9875-de5578e9d504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:00.177803 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b76d5b-3e67-41b0-9875-de5578e9d504 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.189706 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1313/2604] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:45:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:45:00.194417 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66444d92-3dbe-499e-a7bd-1fcd18900801 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:00.203520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66444d92-3dbe-499e-a7bd-1fcd18900801 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:00.208168 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a844-97f1-4c4d-bbb3-48bfeb020d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:00.208806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a844-97f1-4c4d-bbb3-48bfeb020d1b admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.209083 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a844-97f1-4c4d-bbb3-48bfeb020d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.209356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a844-97f1-4c4d-bbb3-48bfeb020d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.210127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6a844-97f1-4c4d-bbb3-48bfeb020d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:00.212007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6a844-97f1-4c4d-bbb3-48bfeb020d1b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.237501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1292/2605] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:00 2021] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:00.242511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b76d5b-3e67-41b0-9875-de5578e9d504 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:00.252942 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b76d5b-3e67-41b0-9875-de5578e9d504 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:00.309662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71021ce8-2228-43b2-b5f8-14038957e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:00.310267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71021ce8-2228-43b2-b5f8-14038957e240 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.310545 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71021ce8-2228-43b2-b5f8-14038957e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.310822 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71021ce8-2228-43b2-b5f8-14038957e240 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.311529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71021ce8-2228-43b2-b5f8-14038957e240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:00.313421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71021ce8-2228-43b2-b5f8-14038957e240 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.333230 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1314/2606] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:00 2021] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:00.337552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a844-97f1-4c4d-bbb3-48bfeb020d1b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:00.348365 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a844-97f1-4c4d-bbb3-48bfeb020d1b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:00.352954 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9757f6e-1719-490c-a48a-1508beed820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:00.353610 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9757f6e-1719-490c-a48a-1508beed820a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.353921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9757f6e-1719-490c-a48a-1508beed820a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.354193 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9757f6e-1719-490c-a48a-1508beed820a admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.354914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9757f6e-1719-490c-a48a-1508beed820a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:00.356492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9757f6e-1719-490c-a48a-1508beed820a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.367262 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1293/2607] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:00.371291 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71021ce8-2228-43b2-b5f8-14038957e240 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:00.381977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71021ce8-2228-43b2-b5f8-14038957e240 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:00.387007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26375ce-fde0-46ac-8127-829d903a387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:00.387684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26375ce-fde0-46ac-8127-829d903a387b admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.387963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26375ce-fde0-46ac-8127-829d903a387b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.388237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26375ce-fde0-46ac-8127-829d903a387b admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.388971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26375ce-fde0-46ac-8127-829d903a387b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:00.390638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26375ce-fde0-46ac-8127-829d903a387b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.401216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1315/2608] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:45:00.406557 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9757f6e-1719-490c-a48a-1508beed820a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:00.417380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9757f6e-1719-490c-a48a-1508beed820a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:00.422068 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854891c7-fbe8-4b89-965f-261008dca57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:00.422945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854891c7-fbe8-4b89-965f-261008dca57b admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.423225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854891c7-fbe8-4b89-965f-261008dca57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.423505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854891c7-fbe8-4b89-965f-261008dca57b admin admin] PATH_INFO: `/v3/projects/fe73a0bf0eee41b184c95a393c0c3986/users/f38d9d14685042aa869519f49ec1d6d2/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.438009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854891c7-fbe8-4b89-965f-261008dca57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe73a0bf0eee41b184c95a393c0c3986, user_id=f38d9d14685042aa869519f49ec1d6d2, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:00.440854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854891c7-fbe8-4b89-965f-261008dca57b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.453451 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1294/2609] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:00 2021] PUT /identity/v3/projects/fe73a0bf0eee41b184c95a393c0c3986/users/f38d9d14685042aa869519f49ec1d6d2/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:00.464298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7589-f4d0-420d-9270-91bda6644eca None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.464609 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7589-f4d0-420d-9270-91bda6644eca None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.464887 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7589-f4d0-420d-9270-91bda6644eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.491154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2d9b7589-f4d0-420d-9270-91bda6644eca None None] MFA Rules not processed for user `f38d9d14685042aa869519f49ec1d6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:00.492345 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2d9b7589-f4d0-420d-9270-91bda6644eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:00.553974 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1316/2610] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:00 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:00.558459 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854891c7-fbe8-4b89-965f-261008dca57b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:00.619283 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854891c7-fbe8-4b89-965f-261008dca57b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:00.623915 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feede4b0-d0d1-470a-b2c4-edf81af1c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:00.624574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feede4b0-d0d1-470a-b2c4-edf81af1c551 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.624853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feede4b0-d0d1-470a-b2c4-edf81af1c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.625125 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feede4b0-d0d1-470a-b2c4-edf81af1c551 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.626359 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feede4b0-d0d1-470a-b2c4-edf81af1c551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:00.627782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feede4b0-d0d1-470a-b2c4-edf81af1c551 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.655667 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1295/2611] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:00 2021] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:00.659886 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b7589-f4d0-420d-9270-91bda6644eca None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:00.670752 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b7589-f4d0-420d-9270-91bda6644eca None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:00.729441 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f14cb3-1ab1-45f2-840e-fa6e2268c250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:00.730133 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14cb3-1ab1-45f2-840e-fa6e2268c250 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.730416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14cb3-1ab1-45f2-840e-fa6e2268c250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.730692 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14cb3-1ab1-45f2-840e-fa6e2268c250 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.731428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f14cb3-1ab1-45f2-840e-fa6e2268c250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:00.733321 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f14cb3-1ab1-45f2-840e-fa6e2268c250 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.757075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1317/2612] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:00 2021] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:00.760899 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feede4b0-d0d1-470a-b2c4-edf81af1c551 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:00.773470 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feede4b0-d0d1-470a-b2c4-edf81af1c551 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:00.779314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae063e-6f0f-4d0b-a3a3-aeef94de3b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:00.780135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae063e-6f0f-4d0b-a3a3-aeef94de3b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.780424 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae063e-6f0f-4d0b-a3a3-aeef94de3b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.780796 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae063e-6f0f-4d0b-a3a3-aeef94de3b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.781712 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae063e-6f0f-4d0b-a3a3-aeef94de3b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:00.783560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae063e-6f0f-4d0b-a3a3-aeef94de3b4e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.798784 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1296/2613] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:00 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:00.800610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f14cb3-1ab1-45f2-840e-fa6e2268c250 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:00.811560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f14cb3-1ab1-45f2-840e-fa6e2268c250 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:00.817356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a29f1-7c48-42c8-b3ed-edfe7f219daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:00.818116 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a29f1-7c48-42c8-b3ed-edfe7f219daf admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.818396 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a29f1-7c48-42c8-b3ed-edfe7f219daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.818691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a29f1-7c48-42c8-b3ed-edfe7f219daf admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.819511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a29f1-7c48-42c8-b3ed-edfe7f219daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:00.821192 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a29f1-7c48-42c8-b3ed-edfe7f219daf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.832521 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1318/2614] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:00.837004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae063e-6f0f-4d0b-a3a3-aeef94de3b4e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:00.847385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae063e-6f0f-4d0b-a3a3-aeef94de3b4e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:00.852641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda9d56-0b55-4f42-8f31-70d36dccde9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:00.853520 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda9d56-0b55-4f42-8f31-70d36dccde9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.853821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda9d56-0b55-4f42-8f31-70d36dccde9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.854097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda9d56-0b55-4f42-8f31-70d36dccde9d admin admin] PATH_INFO: `/v3/projects/60317a5686684b30872b995cebb6eb8e/users/eebf884fdddf46f8ae9cd29386f4d27c/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.869132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda9d56-0b55-4f42-8f31-70d36dccde9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=60317a5686684b30872b995cebb6eb8e, user_id=eebf884fdddf46f8ae9cd29386f4d27c, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:00.871888 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda9d56-0b55-4f42-8f31-70d36dccde9d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:00.886489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1297/2615] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:00 2021] PUT /identity/v3/projects/60317a5686684b30872b995cebb6eb8e/users/eebf884fdddf46f8ae9cd29386f4d27c/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:00.898776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c123-98f5-4714-be52-958590867b97 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:00.899062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c123-98f5-4714-be52-958590867b97 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:00.899344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c123-98f5-4714-be52-958590867b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:00.926337 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-47b8c123-98f5-4714-be52-958590867b97 None None] MFA Rules not processed for user `eebf884fdddf46f8ae9cd29386f4d27c`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:00.927534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-47b8c123-98f5-4714-be52-958590867b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:00.992397 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1319/2616] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:00 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:00.997004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda9d56-0b55-4f42-8f31-70d36dccde9d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:01.069982 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda9d56-0b55-4f42-8f31-70d36dccde9d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:01.075546 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84df45-b307-4580-9e3e-ef138528ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:01.076222 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84df45-b307-4580-9e3e-ef138528ff46 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:01.076498 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84df45-b307-4580-9e3e-ef138528ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:01.076771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84df45-b307-4580-9e3e-ef138528ff46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:01.077477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84df45-b307-4580-9e3e-ef138528ff46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:01.079415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84df45-b307-4580-9e3e-ef138528ff46 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:01.105274 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1298/2617] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:00 2021] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:01.110583 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8c123-98f5-4714-be52-958590867b97 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:01.122669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8c123-98f5-4714-be52-958590867b97 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:01.186422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918439ea-1bea-427f-add2-3a891f404418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:01.187083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918439ea-1bea-427f-add2-3a891f404418 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:01.187361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918439ea-1bea-427f-add2-3a891f404418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:01.187691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918439ea-1bea-427f-add2-3a891f404418 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:01.188475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918439ea-1bea-427f-add2-3a891f404418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:01.190603 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918439ea-1bea-427f-add2-3a891f404418 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:01.211532 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1320/2618] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:01 2021] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:01.215961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84df45-b307-4580-9e3e-ef138528ff46 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:01.227046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84df45-b307-4580-9e3e-ef138528ff46 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:01.232385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d4f2-b66b-4045-bf1b-c1bf9876a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:01.233149 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d4f2-b66b-4045-bf1b-c1bf9876a588 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:01.233505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d4f2-b66b-4045-bf1b-c1bf9876a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:01.233878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d4f2-b66b-4045-bf1b-c1bf9876a588 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:01.234825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721d4f2-b66b-4045-bf1b-c1bf9876a588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:01.236833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721d4f2-b66b-4045-bf1b-c1bf9876a588 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:01.252682 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1299/2619] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:01 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:01.258147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918439ea-1bea-427f-add2-3a891f404418 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:01.269538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918439ea-1bea-427f-add2-3a891f404418 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:01.275666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5265da1-ad0c-4571-b41e-1decde11f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:01.277138 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5265da1-ad0c-4571-b41e-1decde11f754 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:01.277482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5265da1-ad0c-4571-b41e-1decde11f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:01.277990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5265da1-ad0c-4571-b41e-1decde11f754 admin admin] PATH_INFO: `/v3/projects/3bb78832ce9d49bc8e929c84015c42a2/users/5de2393133b442a9b886a62a82f58148/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:01.297977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5265da1-ad0c-4571-b41e-1decde11f754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb78832ce9d49bc8e929c84015c42a2, user_id=5de2393133b442a9b886a62a82f58148, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:01.301155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5265da1-ad0c-4571-b41e-1decde11f754 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:01.319189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1321/2620] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:01 2021] PUT /identity/v3/projects/3bb78832ce9d49bc8e929c84015c42a2/users/5de2393133b442a9b886a62a82f58148/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:01.323768 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d4f2-b66b-4045-bf1b-c1bf9876a588 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:01.334207 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d4f2-b66b-4045-bf1b-c1bf9876a588 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:01.398580 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c52d45-46d9-4a41-b562-c86926f72f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:01.399293 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52d45-46d9-4a41-b562-c86926f72f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:01.399527 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52d45-46d9-4a41-b562-c86926f72f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:01.399875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52d45-46d9-4a41-b562-c86926f72f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:01.400719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c52d45-46d9-4a41-b562-c86926f72f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:01.402671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c52d45-46d9-4a41-b562-c86926f72f98 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:01.414156 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1300/2621] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:01 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:45:01.418137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5265da1-ad0c-4571-b41e-1decde11f754 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:01.429151 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5265da1-ad0c-4571-b41e-1decde11f754 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:01.433895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb119d-d3c5-4dda-b7d3-b8bc5de2c3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:01.434865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb119d-d3c5-4dda-b7d3-b8bc5de2c3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:01.435145 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb119d-d3c5-4dda-b7d3-b8bc5de2c3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:01.435413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb119d-d3c5-4dda-b7d3-b8bc5de2c3bc admin admin] PATH_INFO: `/v3/projects/3bb78832ce9d49bc8e929c84015c42a2/users/5de2393133b442a9b886a62a82f58148/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:01.437482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb119d-d3c5-4dda-b7d3-b8bc5de2c3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb78832ce9d49bc8e929c84015c42a2, user_id=5de2393133b442a9b886a62a82f58148, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:01.440108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb119d-d3c5-4dda-b7d3-b8bc5de2c3bc admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:01.450949 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1322/2622] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:01 2021] PUT /identity/v3/projects/3bb78832ce9d49bc8e929c84015c42a2/users/5de2393133b442a9b886a62a82f58148/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:01.461204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d81bd-7ddf-4166-b409-ea45ae830dba None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:01.461494 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d81bd-7ddf-4166-b409-ea45ae830dba None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:01.461802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d81bd-7ddf-4166-b409-ea45ae830dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:01.490613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-497d81bd-7ddf-4166-b409-ea45ae830dba None None] MFA Rules not processed for user `5de2393133b442a9b886a62a82f58148`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:01.491833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-497d81bd-7ddf-4166-b409-ea45ae830dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:01.557036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1301/2623] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:01 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:01.567566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb119d-d3c5-4dda-b7d3-b8bc5de2c3bc admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:01.569357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-82eb119d-d3c5-4dda-b7d3-b8bc5de2c3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:01.630490 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb119d-d3c5-4dda-b7d3-b8bc5de2c3bc admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:01.634155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84319576-bdc6-4c72-87e6-90f02a4a2754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:01.634794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84319576-bdc6-4c72-87e6-90f02a4a2754 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:01.635071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84319576-bdc6-4c72-87e6-90f02a4a2754 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:01.635344 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84319576-bdc6-4c72-87e6-90f02a4a2754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:01.645228 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84319576-bdc6-4c72-87e6-90f02a4a2754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:01.647781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84319576-bdc6-4c72-87e6-90f02a4a2754 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:01.656922 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1323/2624] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:01 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:01.698465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d81bd-7ddf-4166-b409-ea45ae830dba None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:01.699906 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-497d81bd-7ddf-4166-b409-ea45ae830dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:01.715054 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d81bd-7ddf-4166-b409-ea45ae830dba None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:01.719151 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76524966-6226-4ee1-91dd-03a91a7b2682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:01.720203 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76524966-6226-4ee1-91dd-03a91a7b2682 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:01.720203 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76524966-6226-4ee1-91dd-03a91a7b2682 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:01.720428 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76524966-6226-4ee1-91dd-03a91a7b2682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:01.786339 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76524966-6226-4ee1-91dd-03a91a7b2682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:01.787767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76524966-6226-4ee1-91dd-03a91a7b2682 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:01.796476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1302/2625] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:01 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:04.620377 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84319576-bdc6-4c72-87e6-90f02a4a2754 service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:04.682753 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84319576-bdc6-4c72-87e6-90f02a4a2754 service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:04.687297 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:04.688158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:04.688439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:04.688714 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] PATH_INFO: `/v3/users/f38d9d14685042aa869519f49ec1d6d2` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:04.689934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38d9d14685042aa869519f49ec1d6d2)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:04.691881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:04.736647 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38d9d14685042aa869519f49ec1d6d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:04.744109 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38d9d14685042aa869519f49ec1d6d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:04.744767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38d9d14685042aa869519f49ec1d6d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:04.755980 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38d9d14685042aa869519f49ec1d6d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:04.756604 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38d9d14685042aa869519f49ec1d6d2'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:04.768431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1324/2626] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:04 2021] DELETE /identity/v3/users/f38d9d14685042aa869519f49ec1d6d2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:04.773597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c523-2d51-4625-beb8-2b18a08ad4ef None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:04.774115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c523-2d51-4625-beb8-2b18a08ad4ef None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:04.774225 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c523-2d51-4625-beb8-2b18a08ad4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:04.791561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-04d7c523-2d51-4625-beb8-2b18a08ad4ef None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:04.792652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-04d7c523-2d51-4625-beb8-2b18a08ad4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:04.848195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1303/2627] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:04.858253 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:04.859633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:04.917475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb856043-0439-4b99-b89f-b36642618373 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:04.921187 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e0e0-f1fe-4493-805c-b36479a475eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:04.921937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e0e0-f1fe-4493-805c-b36479a475eb service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:04.922256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e0e0-f1fe-4493-805c-b36479a475eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:04.922624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e0e0-f1fe-4493-805c-b36479a475eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:04.931934 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e0e0-f1fe-4493-805c-b36479a475eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:04.933343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e0e0-f1fe-4493-805c-b36479a475eb service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:04.942744 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1325/2628] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:45:05.198577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7c523-2d51-4625-beb8-2b18a08ad4ef None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:05.200219 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-04d7c523-2d51-4625-beb8-2b18a08ad4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:05.213304 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7c523-2d51-4625-beb8-2b18a08ad4ef None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:05.218182 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:05.219056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:05.219333 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:05.219607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] PATH_INFO: `/v3/projects/fe73a0bf0eee41b184c95a393c0c3986` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:05.220972 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe73a0bf0eee41b184c95a393c0c3986)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:05.223294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:05.273413 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe73a0bf0eee41b184c95a393c0c3986', 'request_id': 'req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.279472 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe73a0bf0eee41b184c95a393c0c3986', 'request_id': 'req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.290908 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe73a0bf0eee41b184c95a393c0c3986', 'request_id': 'req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.301585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] The token cache is being invalidate because project fe73a0bf0eee41b184c95a393c0c3986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:05.301897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.302511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.304016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1304/2629] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:05 2021] DELETE /identity/v3/projects/fe73a0bf0eee41b184c95a393c0c3986 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:05.308045 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e0e0-f1fe-4493-805c-b36479a475eb service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:05.317981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e0e0-f1fe-4493-805c-b36479a475eb service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:05.371932 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:05.372798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:05.373078 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:05.373348 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] PATH_INFO: `/v3/users/eebf884fdddf46f8ae9cd29386f4d27c` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:05.374569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eebf884fdddf46f8ae9cd29386f4d27c)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:05.376528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:05.423498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eebf884fdddf46f8ae9cd29386f4d27c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.431757 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eebf884fdddf46f8ae9cd29386f4d27c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.432796 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eebf884fdddf46f8ae9cd29386f4d27c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.450413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eebf884fdddf46f8ae9cd29386f4d27c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.451338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eebf884fdddf46f8ae9cd29386f4d27c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.468383 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1326/2630] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:05 2021] DELETE /identity/v3/users/eebf884fdddf46f8ae9cd29386f4d27c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:05.777542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:05.779304 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:05.794392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6922f89-f6bb-4b3f-a2db-6b407d5a761b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:05.853383 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:05.854864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:05.855353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:05.855697 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] PATH_INFO: `/v3/projects/60317a5686684b30872b995cebb6eb8e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:05.857089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60317a5686684b30872b995cebb6eb8e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:05.859600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:05.914004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60317a5686684b30872b995cebb6eb8e', 'request_id': 'req-a0214ffc-ebd4-4dac-95e7-e73f690e8519'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.921804 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60317a5686684b30872b995cebb6eb8e', 'request_id': 'req-a0214ffc-ebd4-4dac-95e7-e73f690e8519'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.930096 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60317a5686684b30872b995cebb6eb8e', 'request_id': 'req-a0214ffc-ebd4-4dac-95e7-e73f690e8519'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.942537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] The token cache is being invalidate because project 60317a5686684b30872b995cebb6eb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:05.942905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.943582 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:05.945328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1305/2631] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:05 2021] DELETE /identity/v3/projects/60317a5686684b30872b995cebb6eb8e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:05.949294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:05.950701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:05.963704 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3669e-6a2a-4691-b2df-9ce5742c3c58 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:06.020487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6f5d3-6079-4c03-a8e3-5811eae3e150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:06.021355 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6f5d3-6079-4c03-a8e3-5811eae3e150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:06.021639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6f5d3-6079-4c03-a8e3-5811eae3e150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:06.021952 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6f5d3-6079-4c03-a8e3-5811eae3e150 admin admin] PATH_INFO: `/v3/users/5de2393133b442a9b886a62a82f58148` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:06.023147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6f5d3-6079-4c03-a8e3-5811eae3e150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de2393133b442a9b886a62a82f58148)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:06.025115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6f5d3-6079-4c03-a8e3-5811eae3e150 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:06.071122 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-06f6f5d3-6079-4c03-a8e3-5811eae3e150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de2393133b442a9b886a62a82f58148'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:06.077574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-06f6f5d3-6079-4c03-a8e3-5811eae3e150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de2393133b442a9b886a62a82f58148'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:06.078260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-06f6f5d3-6079-4c03-a8e3-5811eae3e150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de2393133b442a9b886a62a82f58148'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:06.090943 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-06f6f5d3-6079-4c03-a8e3-5811eae3e150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de2393133b442a9b886a62a82f58148'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:06.091580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-06f6f5d3-6079-4c03-a8e3-5811eae3e150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de2393133b442a9b886a62a82f58148'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:06.103701 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1327/2632] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:05 2021] DELETE /identity/v3/users/5de2393133b442a9b886a62a82f58148 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:06.359569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:06.361739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:06.376040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0214ffc-ebd4-4dac-95e7-e73f690e8519 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:06.432231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:06.433105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:06.433387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:06.433664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] PATH_INFO: `/v3/projects/3bb78832ce9d49bc8e929c84015c42a2` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:06.434891 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb78832ce9d49bc8e929c84015c42a2)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:06.436793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:06.483457 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb78832ce9d49bc8e929c84015c42a2', 'request_id': 'req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:06.489341 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb78832ce9d49bc8e929c84015c42a2', 'request_id': 'req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:06.497380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb78832ce9d49bc8e929c84015c42a2', 'request_id': 'req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:06.507383 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] The token cache is being invalidate because project 3bb78832ce9d49bc8e929c84015c42a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:06.507671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:06.508294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-1ac1ead0-29a4-4ffb-8319-97f2cf6ae2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:06.509844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1306/2633] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:06 2021] DELETE /identity/v3/projects/3bb78832ce9d49bc8e929c84015c42a2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:06.516943 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586733e4-f7c4-4f1f-8bae-ea1ffd44bddf None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:06.517330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586733e4-f7c4-4f1f-8bae-ea1ffd44bddf None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:06.517672 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586733e4-f7c4-4f1f-8bae-ea1ffd44bddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:06.537008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-586733e4-f7c4-4f1f-8bae-ea1ffd44bddf None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:06.538320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-586733e4-f7c4-4f1f-8bae-ea1ffd44bddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:06.595732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1328/2634] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:06.605560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf46709-dc49-4ce5-96a6-2a8c99565717 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:06.605889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf46709-dc49-4ce5-96a6-2a8c99565717 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:06.606169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf46709-dc49-4ce5-96a6-2a8c99565717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:06.624009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-acf46709-dc49-4ce5-96a6-2a8c99565717 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:06.625190 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-acf46709-dc49-4ce5-96a6-2a8c99565717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:06.634535 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1307/2635] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:06.638684 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586733e4-f7c4-4f1f-8bae-ea1ffd44bddf None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:06.648845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586733e4-f7c4-4f1f-8bae-ea1ffd44bddf None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:06.653408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e6cb4-a83c-458d-8a39-86f08b61b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:06.654089 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e6cb4-a83c-458d-8a39-86f08b61b6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:06.654370 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e6cb4-a83c-458d-8a39-86f08b61b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:06.654640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e6cb4-a83c-458d-8a39-86f08b61b6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:06.655367 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e6cb4-a83c-458d-8a39-86f08b61b6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:45:06.655669 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e6cb4-a83c-458d-8a39-86f08b61b6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:06.657233 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e6cb4-a83c-458d-8a39-86f08b61b6b4 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:06.668651 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1329/2636] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:45:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:45:06.672993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf46709-dc49-4ce5-96a6-2a8c99565717 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:06.682218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf46709-dc49-4ce5-96a6-2a8c99565717 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:06.686878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460301f2-6781-42c2-81ac-ec005c470bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:06.687516 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460301f2-6781-42c2-81ac-ec005c470bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:06.687798 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460301f2-6781-42c2-81ac-ec005c470bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:06.688065 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460301f2-6781-42c2-81ac-ec005c470bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:06.688780 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460301f2-6781-42c2-81ac-ec005c470bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:06.690709 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460301f2-6781-42c2-81ac-ec005c470bf0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:06.716448 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1308/2637] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:06 2021] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:06.722011 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e6cb4-a83c-458d-8a39-86f08b61b6b4 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:06.732052 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e6cb4-a83c-458d-8a39-86f08b61b6b4 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:06.788303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18726755-5312-4d05-9959-4f4a042a1073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:06.788978 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18726755-5312-4d05-9959-4f4a042a1073 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:06.789258 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18726755-5312-4d05-9959-4f4a042a1073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:06.789534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18726755-5312-4d05-9959-4f4a042a1073 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:06.790271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18726755-5312-4d05-9959-4f4a042a1073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:06.792165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18726755-5312-4d05-9959-4f4a042a1073 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:06.811072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1330/2638] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:06 2021] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:06.815200 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460301f2-6781-42c2-81ac-ec005c470bf0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:06.825773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460301f2-6781-42c2-81ac-ec005c470bf0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:06.830381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078d920-549e-4156-a296-8b0fd9ca44b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:06.831039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078d920-549e-4156-a296-8b0fd9ca44b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:06.831318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078d920-549e-4156-a296-8b0fd9ca44b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:06.831591 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078d920-549e-4156-a296-8b0fd9ca44b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:06.832910 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078d920-549e-4156-a296-8b0fd9ca44b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:06.834552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078d920-549e-4156-a296-8b0fd9ca44b7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:06.844652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1309/2639] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:06.848710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18726755-5312-4d05-9959-4f4a042a1073 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:06.858798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18726755-5312-4d05-9959-4f4a042a1073 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:06.863381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6abfe2-373a-422d-a1e6-99269f70f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:06.864053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6abfe2-373a-422d-a1e6-99269f70f80f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:06.864334 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6abfe2-373a-422d-a1e6-99269f70f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:06.864608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6abfe2-373a-422d-a1e6-99269f70f80f admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:06.865339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6abfe2-373a-422d-a1e6-99269f70f80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:06.867153 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6abfe2-373a-422d-a1e6-99269f70f80f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:06.876838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1331/2640] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:06.881294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078d920-549e-4156-a296-8b0fd9ca44b7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:06.891135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078d920-549e-4156-a296-8b0fd9ca44b7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:06.896447 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36b434-108a-4fc0-ab47-123d2878673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:06.897316 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36b434-108a-4fc0-ab47-123d2878673e admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:06.897597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36b434-108a-4fc0-ab47-123d2878673e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:06.897903 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36b434-108a-4fc0-ab47-123d2878673e admin admin] PATH_INFO: `/v3/projects/b364900bfb13473191d5c42a9a4874f1/users/9935ad6cec4d480380d70689b161104e/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:06.912840 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36b434-108a-4fc0-ab47-123d2878673e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b364900bfb13473191d5c42a9a4874f1, user_id=9935ad6cec4d480380d70689b161104e, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:06.915488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36b434-108a-4fc0-ab47-123d2878673e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:06.928017 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1310/2641] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:06 2021] PUT /identity/v3/projects/b364900bfb13473191d5c42a9a4874f1/users/9935ad6cec4d480380d70689b161104e/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:06.938881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065fa3-5940-465f-b828-45ae892963c2 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:06.939184 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065fa3-5940-465f-b828-45ae892963c2 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:06.939457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065fa3-5940-465f-b828-45ae892963c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:06.966522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-9d065fa3-5940-465f-b828-45ae892963c2 None None] MFA Rules not processed for user `9935ad6cec4d480380d70689b161104e`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:06.967667 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9d065fa3-5940-465f-b828-45ae892963c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:07.029798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1332/2642] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:07.041806 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36b434-108a-4fc0-ab47-123d2878673e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:07.043490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4e36b434-108a-4fc0-ab47-123d2878673e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:07.098470 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36b434-108a-4fc0-ab47-123d2878673e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:07.102063 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cba4d-b9e2-4576-ac07-25229ce6b46a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ddafedf2734326832ab4bf620f7634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:07.102697 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cba4d-b9e2-4576-ac07-25229ce6b46a service glance] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:07.103003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cba4d-b9e2-4576-ac07-25229ce6b46a service glance] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:07.103282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cba4d-b9e2-4576-ac07-25229ce6b46a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:07.111634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cba4d-b9e2-4576-ac07-25229ce6b46a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:07.113121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cba4d-b9e2-4576-ac07-25229ce6b46a service glance] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:07.121961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1311/2643] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:07 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:24.599696 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d065fa3-5940-465f-b828-45ae892963c2 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:24.677648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d065fa3-5940-465f-b828-45ae892963c2 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:24.682752 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:24.683721 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:24.684013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:24.684314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] PATH_INFO: `/v3/users/9935ad6cec4d480380d70689b161104e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:24.685610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9935ad6cec4d480380d70689b161104e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:24.687767 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:24.736184 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9935ad6cec4d480380d70689b161104e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:24.743979 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9935ad6cec4d480380d70689b161104e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:24.744699 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9935ad6cec4d480380d70689b161104e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:24.756508 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9935ad6cec4d480380d70689b161104e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:24.757193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9935ad6cec4d480380d70689b161104e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:24.769996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1333/2644] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:24 2021] DELETE /identity/v3/users/9935ad6cec4d480380d70689b161104e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:24.774575 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a9ed-a35b-43c3-aba5-187105765c1d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:24.775110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a9ed-a35b-43c3-aba5-187105765c1d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:24.775110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a9ed-a35b-43c3-aba5-187105765c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:24.793409 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-0585a9ed-a35b-43c3-aba5-187105765c1d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:24.794651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0585a9ed-a35b-43c3-aba5-187105765c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:24.852119 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1312/2645] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:24.862266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:24.863851 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:24.924085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732eda8-1884-4771-ad7a-35a56b9bd6a3 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:24.928272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfa33d-78a0-47ea-80ad-bdc8f53de460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:24.928936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfa33d-78a0-47ea-80ad-bdc8f53de460 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:24.929213 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfa33d-78a0-47ea-80ad-bdc8f53de460 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:24.929479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfa33d-78a0-47ea-80ad-bdc8f53de460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:24.939428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfa33d-78a0-47ea-80ad-bdc8f53de460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:24.940895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfa33d-78a0-47ea-80ad-bdc8f53de460 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:24.951864 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1334/2646] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:25.235663 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585a9ed-a35b-43c3-aba5-187105765c1d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:25.241094 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0585a9ed-a35b-43c3-aba5-187105765c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:25.265603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585a9ed-a35b-43c3-aba5-187105765c1d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:25.275040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:25.276218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:25.276691 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:25.276970 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] PATH_INFO: `/v3/projects/b364900bfb13473191d5c42a9a4874f1` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:25.285135 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b364900bfb13473191d5c42a9a4874f1)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:25.288264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:25.343731 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b364900bfb13473191d5c42a9a4874f1', 'request_id': 'req-407f5172-9b55-46ca-8f38-73396cb409d3'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:25.350923 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b364900bfb13473191d5c42a9a4874f1', 'request_id': 'req-407f5172-9b55-46ca-8f38-73396cb409d3'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:25.357892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b364900bfb13473191d5c42a9a4874f1', 'request_id': 'req-407f5172-9b55-46ca-8f38-73396cb409d3'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:25.367900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] The token cache is being invalidate because project b364900bfb13473191d5c42a9a4874f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:25.368188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:25.368829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-407f5172-9b55-46ca-8f38-73396cb409d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:25.370401 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1313/2647] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:25 2021] DELETE /identity/v3/projects/b364900bfb13473191d5c42a9a4874f1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:25.376488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db56d8-36a5-45fd-bf7d-592e88d46f71 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:25.376831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db56d8-36a5-45fd-bf7d-592e88d46f71 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:25.377112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db56d8-36a5-45fd-bf7d-592e88d46f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:25.396458 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-57db56d8-36a5-45fd-bf7d-592e88d46f71 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:25.397676 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-57db56d8-36a5-45fd-bf7d-592e88d46f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:25.460919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1335/2648] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:25.468936 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1170b6-1526-42ad-89df-fb6b41dc32f8 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:25.469266 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1170b6-1526-42ad-89df-fb6b41dc32f8 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:25.469524 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1170b6-1526-42ad-89df-fb6b41dc32f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:25.488565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-aa1170b6-1526-42ad-89df-fb6b41dc32f8 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:25.490394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-aa1170b6-1526-42ad-89df-fb6b41dc32f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:25.498664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1314/2649] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:25.503168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db56d8-36a5-45fd-bf7d-592e88d46f71 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:25.513140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db56d8-36a5-45fd-bf7d-592e88d46f71 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:25.517797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d2b0-00bd-499e-a5ed-5388eceb57c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:25.518549 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d2b0-00bd-499e-a5ed-5388eceb57c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:25.518835 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d2b0-00bd-499e-a5ed-5388eceb57c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:25.519137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d2b0-00bd-499e-a5ed-5388eceb57c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:25.519897 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d2b0-00bd-499e-a5ed-5388eceb57c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:45:25.520260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d2b0-00bd-499e-a5ed-5388eceb57c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:25.521977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d2b0-00bd-499e-a5ed-5388eceb57c4 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:25.534071 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1336/2650] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:45:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:45:25.538987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1170b6-1526-42ad-89df-fb6b41dc32f8 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:25.548058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1170b6-1526-42ad-89df-fb6b41dc32f8 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:25.553350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29051fa6-73f6-4286-b26e-40224aea2735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:25.554049 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051fa6-73f6-4286-b26e-40224aea2735 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:25.554332 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051fa6-73f6-4286-b26e-40224aea2735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:25.554603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051fa6-73f6-4286-b26e-40224aea2735 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:25.555314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29051fa6-73f6-4286-b26e-40224aea2735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:25.557208 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29051fa6-73f6-4286-b26e-40224aea2735 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:25.585588 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1315/2651] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:25 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:25.589390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d2b0-00bd-499e-a5ed-5388eceb57c4 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:25.600333 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d2b0-00bd-499e-a5ed-5388eceb57c4 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:25.665009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7c86a-986b-4491-a319-28a9a41cfe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:25.666171 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7c86a-986b-4491-a319-28a9a41cfe72 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:25.666556 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7c86a-986b-4491-a319-28a9a41cfe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:25.666930 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7c86a-986b-4491-a319-28a9a41cfe72 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:25.667742 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7c86a-986b-4491-a319-28a9a41cfe72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:25.670006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7c86a-986b-4491-a319-28a9a41cfe72 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:25.692216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1337/2652] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:25 2021] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:25.696568 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29051fa6-73f6-4286-b26e-40224aea2735 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:25.708444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29051fa6-73f6-4286-b26e-40224aea2735 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:25.715605 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f465fa-9bfd-4c84-821d-27846891c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:25.717052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f465fa-9bfd-4c84-821d-27846891c26d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:25.717337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f465fa-9bfd-4c84-821d-27846891c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:25.717782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f465fa-9bfd-4c84-821d-27846891c26d admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:25.718805 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f465fa-9bfd-4c84-821d-27846891c26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:25.720079 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f465fa-9bfd-4c84-821d-27846891c26d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:25.735778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1316/2653] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:25.740366 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7c86a-986b-4491-a319-28a9a41cfe72 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:25.750596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7c86a-986b-4491-a319-28a9a41cfe72 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:25.755246 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c310f-85ed-414b-8c78-b5c5dae4b78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:25.755906 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c310f-85ed-414b-8c78-b5c5dae4b78f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:25.756186 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c310f-85ed-414b-8c78-b5c5dae4b78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:25.756454 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c310f-85ed-414b-8c78-b5c5dae4b78f admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:25.757213 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c310f-85ed-414b-8c78-b5c5dae4b78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:25.758974 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c310f-85ed-414b-8c78-b5c5dae4b78f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:25.770947 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1338/2654] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:25.775188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f465fa-9bfd-4c84-821d-27846891c26d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:25.784741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f465fa-9bfd-4c84-821d-27846891c26d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:25.789733 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a40901-e4bb-4d26-ab83-ceb86f51246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:25.790647 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a40901-e4bb-4d26-ab83-ceb86f51246f admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:25.790920 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a40901-e4bb-4d26-ab83-ceb86f51246f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:25.791188 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a40901-e4bb-4d26-ab83-ceb86f51246f admin admin] PATH_INFO: `/v3/projects/7d169c0306d0485a880d062bc3a6766f/users/495f484852cd48beb4719999a1026ea0/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:25.807719 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a40901-e4bb-4d26-ab83-ceb86f51246f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d169c0306d0485a880d062bc3a6766f, user_id=495f484852cd48beb4719999a1026ea0, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:25.810598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a40901-e4bb-4d26-ab83-ceb86f51246f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:25.824846 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1317/2655] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:25 2021] PUT /identity/v3/projects/7d169c0306d0485a880d062bc3a6766f/users/495f484852cd48beb4719999a1026ea0/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:25.836956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91063dd8-4d9b-4b16-b269-23059b41783d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:25.837316 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91063dd8-4d9b-4b16-b269-23059b41783d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:25.837720 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91063dd8-4d9b-4b16-b269-23059b41783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:25.868561 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-91063dd8-4d9b-4b16-b269-23059b41783d None None] MFA Rules not processed for user `495f484852cd48beb4719999a1026ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:25.870243 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-91063dd8-4d9b-4b16-b269-23059b41783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:25.945245 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1339/2656] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:25 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:25.953016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a40901-e4bb-4d26-ab83-ceb86f51246f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:25.954875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c6a40901-e4bb-4d26-ab83-ceb86f51246f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:26.019415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a40901-e4bb-4d26-ab83-ceb86f51246f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:26.024602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa9869-7e6b-48de-8a8c-23f94859ac96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:26.025265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa9869-7e6b-48de-8a8c-23f94859ac96 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:26.025550 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa9869-7e6b-48de-8a8c-23f94859ac96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:26.025841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa9869-7e6b-48de-8a8c-23f94859ac96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:26.036133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa9869-7e6b-48de-8a8c-23f94859ac96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:26.042452 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa9869-7e6b-48de-8a8c-23f94859ac96 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:26.059489 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1318/2657] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:25 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:27.548921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91063dd8-4d9b-4b16-b269-23059b41783d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:27.550768 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-91063dd8-4d9b-4b16-b269-23059b41783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:27.629189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91063dd8-4d9b-4b16-b269-23059b41783d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:27.636385 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc5968-08a8-4e6f-ad86-a7da3d668402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:27.637330 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc5968-08a8-4e6f-ad86-a7da3d668402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:27.637682 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc5968-08a8-4e6f-ad86-a7da3d668402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:27.638080 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc5968-08a8-4e6f-ad86-a7da3d668402 admin admin] PATH_INFO: `/v3/users/4c98a5d1c09e43c99bcbc1e9785d1edd` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:27.639371 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc5968-08a8-4e6f-ad86-a7da3d668402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c98a5d1c09e43c99bcbc1e9785d1edd)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:27.641356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc5968-08a8-4e6f-ad86-a7da3d668402 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:27.688874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-73fc5968-08a8-4e6f-ad86-a7da3d668402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c98a5d1c09e43c99bcbc1e9785d1edd'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:27.696375 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-73fc5968-08a8-4e6f-ad86-a7da3d668402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c98a5d1c09e43c99bcbc1e9785d1edd'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:27.697049 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-73fc5968-08a8-4e6f-ad86-a7da3d668402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c98a5d1c09e43c99bcbc1e9785d1edd'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:27.709380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-73fc5968-08a8-4e6f-ad86-a7da3d668402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c98a5d1c09e43c99bcbc1e9785d1edd'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:27.710080 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-73fc5968-08a8-4e6f-ad86-a7da3d668402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c98a5d1c09e43c99bcbc1e9785d1edd'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:27.723378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1340/2658] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:27 2021] DELETE /identity/v3/users/4c98a5d1c09e43c99bcbc1e9785d1edd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:27.901693 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa9869-7e6b-48de-8a8c-23f94859ac96 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:27.915236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa9869-7e6b-48de-8a8c-23f94859ac96 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:27.974933 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:27.976114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:27.976114 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:27.976327 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] PATH_INFO: `/v3/projects/10799d1b1db34e69a6c6bba276744b0f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:27.977845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10799d1b1db34e69a6c6bba276744b0f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:27.979785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.031292 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10799d1b1db34e69a6c6bba276744b0f', 'request_id': 'req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:28.039617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10799d1b1db34e69a6c6bba276744b0f', 'request_id': 'req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:28.048501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10799d1b1db34e69a6c6bba276744b0f', 'request_id': 'req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:28.062627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] The token cache is being invalidate because project 10799d1b1db34e69a6c6bba276744b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:28.062914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:28.063567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e18e4d85-f57a-4cc4-bdf9-408c1aea5a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:28.065127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1319/2659] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:27 2021] DELETE /identity/v3/projects/10799d1b1db34e69a6c6bba276744b0f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:28.071752 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d7f5-0d44-41ca-b7b1-13361563876e None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.072043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d7f5-0d44-41ca-b7b1-13361563876e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.072323 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d7f5-0d44-41ca-b7b1-13361563876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.091670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-1b50d7f5-0d44-41ca-b7b1-13361563876e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:28.092873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1b50d7f5-0d44-41ca-b7b1-13361563876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:28.153774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1341/2660] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:28.161905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db17fb6-03ae-459d-a7b3-28658c564f72 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.162297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db17fb6-03ae-459d-a7b3-28658c564f72 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.162644 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db17fb6-03ae-459d-a7b3-28658c564f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.182754 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-2db17fb6-03ae-459d-a7b3-28658c564f72 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:28.184211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2db17fb6-03ae-459d-a7b3-28658c564f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:28.193795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1320/2661] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:28.198299 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50d7f5-0d44-41ca-b7b1-13361563876e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.208479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50d7f5-0d44-41ca-b7b1-13361563876e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.213497 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b02538-0f5c-4694-a3ef-b23e7aba4849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.214307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02538-0f5c-4694-a3ef-b23e7aba4849 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.214643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02538-0f5c-4694-a3ef-b23e7aba4849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.215021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02538-0f5c-4694-a3ef-b23e7aba4849 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.215837 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b02538-0f5c-4694-a3ef-b23e7aba4849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:45:28.216204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b02538-0f5c-4694-a3ef-b23e7aba4849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.218027 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b02538-0f5c-4694-a3ef-b23e7aba4849 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.233321 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1342/2662] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:45:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:45:28.234696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db17fb6-03ae-459d-a7b3-28658c564f72 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.245206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db17fb6-03ae-459d-a7b3-28658c564f72 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.250230 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdcaaf-e0e9-46ae-b048-075db8a272ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.250882 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdcaaf-e0e9-46ae-b048-075db8a272ce admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.251164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdcaaf-e0e9-46ae-b048-075db8a272ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.251440 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdcaaf-e0e9-46ae-b048-075db8a272ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.252143 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdcaaf-e0e9-46ae-b048-075db8a272ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.254317 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdcaaf-e0e9-46ae-b048-075db8a272ce admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.279873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1321/2663] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:28 2021] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:28.283921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b02538-0f5c-4694-a3ef-b23e7aba4849 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.294305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b02538-0f5c-4694-a3ef-b23e7aba4849 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.350959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aee6e-9c91-4ce0-b9ff-90965ccb3d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.351626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aee6e-9c91-4ce0-b9ff-90965ccb3d9a admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.351914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aee6e-9c91-4ce0-b9ff-90965ccb3d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.352191 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aee6e-9c91-4ce0-b9ff-90965ccb3d9a admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.352889 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aee6e-9c91-4ce0-b9ff-90965ccb3d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.354845 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aee6e-9c91-4ce0-b9ff-90965ccb3d9a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.374640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1343/2664] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:28 2021] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:28.378864 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdcaaf-e0e9-46ae-b048-075db8a272ce admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.390017 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdcaaf-e0e9-46ae-b048-075db8a272ce admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.394620 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a9fe5-b394-4bba-8091-c71f4ca20015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.395272 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a9fe5-b394-4bba-8091-c71f4ca20015 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.395552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a9fe5-b394-4bba-8091-c71f4ca20015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.395826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a9fe5-b394-4bba-8091-c71f4ca20015 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.396556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a9fe5-b394-4bba-8091-c71f4ca20015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.398222 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a9fe5-b394-4bba-8091-c71f4ca20015 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.409253 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1322/2665] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:28.413749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aee6e-9c91-4ce0-b9ff-90965ccb3d9a admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.423736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aee6e-9c91-4ce0-b9ff-90965ccb3d9a admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.429044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cede7d3-f07d-4db4-9d37-aa7cc631fd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.429681 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cede7d3-f07d-4db4-9d37-aa7cc631fd1f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.430003 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cede7d3-f07d-4db4-9d37-aa7cc631fd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.430279 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cede7d3-f07d-4db4-9d37-aa7cc631fd1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.431008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cede7d3-f07d-4db4-9d37-aa7cc631fd1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.432607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cede7d3-f07d-4db4-9d37-aa7cc631fd1f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.442343 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1344/2666] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:28.446292 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a9fe5-b394-4bba-8091-c71f4ca20015 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.455838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a9fe5-b394-4bba-8091-c71f4ca20015 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.461610 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4d8c5-7b86-4349-ada3-9f4b19ae3af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.462553 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4d8c5-7b86-4349-ada3-9f4b19ae3af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.462834 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4d8c5-7b86-4349-ada3-9f4b19ae3af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.463131 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4d8c5-7b86-4349-ada3-9f4b19ae3af1 admin admin] PATH_INFO: `/v3/projects/e1e3b22e5dec4def9d67933e8d731236/users/af82aaf4288a415f9c5149a108817ccd/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.478540 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4d8c5-7b86-4349-ada3-9f4b19ae3af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e3b22e5dec4def9d67933e8d731236, user_id=af82aaf4288a415f9c5149a108817ccd, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.481177 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4d8c5-7b86-4349-ada3-9f4b19ae3af1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.494803 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1323/2667] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:28 2021] PUT /identity/v3/projects/e1e3b22e5dec4def9d67933e8d731236/users/af82aaf4288a415f9c5149a108817ccd/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:28.511877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3e7b6-dd0d-4e6b-8a09-696e456eb37b None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.512164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3e7b6-dd0d-4e6b-8a09-696e456eb37b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.512546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3e7b6-dd0d-4e6b-8a09-696e456eb37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.538602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5fd3e7b6-dd0d-4e6b-8a09-696e456eb37b None None] MFA Rules not processed for user `af82aaf4288a415f9c5149a108817ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:28.539796 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5fd3e7b6-dd0d-4e6b-8a09-696e456eb37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:28.601365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1345/2668] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:28 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:28.605785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4d8c5-7b86-4349-ada3-9f4b19ae3af1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.669396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4d8c5-7b86-4349-ada3-9f4b19ae3af1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.674166 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58505fa7-9ccc-4359-8190-df87bc8ecf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.674820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505fa7-9ccc-4359-8190-df87bc8ecf37 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.675104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505fa7-9ccc-4359-8190-df87bc8ecf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.675381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505fa7-9ccc-4359-8190-df87bc8ecf37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.676093 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58505fa7-9ccc-4359-8190-df87bc8ecf37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.678706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58505fa7-9ccc-4359-8190-df87bc8ecf37 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.703965 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1324/2669] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:28 2021] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:28.707927 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3e7b6-dd0d-4e6b-8a09-696e456eb37b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.718516 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3e7b6-dd0d-4e6b-8a09-696e456eb37b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.773969 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d05692-ebaa-4786-b9b0-9d6a8e9d8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.774631 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05692-ebaa-4786-b9b0-9d6a8e9d8c51 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.774915 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05692-ebaa-4786-b9b0-9d6a8e9d8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.775189 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05692-ebaa-4786-b9b0-9d6a8e9d8c51 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.775890 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d05692-ebaa-4786-b9b0-9d6a8e9d8c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.777834 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d05692-ebaa-4786-b9b0-9d6a8e9d8c51 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.797224 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1346/2670] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:28 2021] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:28.801150 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58505fa7-9ccc-4359-8190-df87bc8ecf37 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.811086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58505fa7-9ccc-4359-8190-df87bc8ecf37 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.815585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3f8b-f83e-4bc7-807b-883e3467f54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.816229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3f8b-f83e-4bc7-807b-883e3467f54c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.816503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3f8b-f83e-4bc7-807b-883e3467f54c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.816792 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3f8b-f83e-4bc7-807b-883e3467f54c admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.817514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de3f8b-f83e-4bc7-807b-883e3467f54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.819210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de3f8b-f83e-4bc7-807b-883e3467f54c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.829385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1325/2671] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:28.833781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d05692-ebaa-4786-b9b0-9d6a8e9d8c51 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.843386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d05692-ebaa-4786-b9b0-9d6a8e9d8c51 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.847976 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44ed3e-ed7f-449f-9273-e28cad10ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.849637 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44ed3e-ed7f-449f-9273-e28cad10ba9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.849944 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44ed3e-ed7f-449f-9273-e28cad10ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.850241 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44ed3e-ed7f-449f-9273-e28cad10ba9e admin admin] PATH_INFO: `/v3/projects/2f5fcd7ac73b40329303364c0a38dba8/users/90e22fe8e710412391293448247cbc7e/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.864444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44ed3e-ed7f-449f-9273-e28cad10ba9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5fcd7ac73b40329303364c0a38dba8, user_id=90e22fe8e710412391293448247cbc7e, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.867100 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44ed3e-ed7f-449f-9273-e28cad10ba9e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.879403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1347/2672] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:28 2021] PUT /identity/v3/projects/2f5fcd7ac73b40329303364c0a38dba8/users/90e22fe8e710412391293448247cbc7e/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:28.883256 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3f8b-f83e-4bc7-807b-883e3467f54c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.893214 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3f8b-f83e-4bc7-807b-883e3467f54c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.947228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b500337-1290-4c54-87c6-ab97c49ad9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.947892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b500337-1290-4c54-87c6-ab97c49ad9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.948170 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b500337-1290-4c54-87c6-ab97c49ad9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.948443 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b500337-1290-4c54-87c6-ab97c49ad9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.949169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b500337-1290-4c54-87c6-ab97c49ad9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.950781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b500337-1290-4c54-87c6-ab97c49ad9f3 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.960308 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1326/2673] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:28 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:28.964464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44ed3e-ed7f-449f-9273-e28cad10ba9e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:28.974700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44ed3e-ed7f-449f-9273-e28cad10ba9e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:28.979261 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab95e2-9fad-4a83-a5b7-84b6e15c628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:28.980132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab95e2-9fad-4a83-a5b7-84b6e15c628e admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:28.980412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab95e2-9fad-4a83-a5b7-84b6e15c628e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:28.980686 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab95e2-9fad-4a83-a5b7-84b6e15c628e admin admin] PATH_INFO: `/v3/projects/2f5fcd7ac73b40329303364c0a38dba8/users/90e22fe8e710412391293448247cbc7e/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:28.982710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab95e2-9fad-4a83-a5b7-84b6e15c628e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5fcd7ac73b40329303364c0a38dba8, user_id=90e22fe8e710412391293448247cbc7e, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:28.985341 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab95e2-9fad-4a83-a5b7-84b6e15c628e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:28.995818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1348/2674] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:28 2021] PUT /identity/v3/projects/2f5fcd7ac73b40329303364c0a38dba8/users/90e22fe8e710412391293448247cbc7e/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:29.006205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d38b3-f879-4269-8a36-2114cb95ff62 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:29.006496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d38b3-f879-4269-8a36-2114cb95ff62 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:29.006771 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d38b3-f879-4269-8a36-2114cb95ff62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:29.032033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-9f9d38b3-f879-4269-8a36-2114cb95ff62 None None] MFA Rules not processed for user `90e22fe8e710412391293448247cbc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:29.033220 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9f9d38b3-f879-4269-8a36-2114cb95ff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:29.097549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1327/2675] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:29 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:29.104871 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab95e2-9fad-4a83-a5b7-84b6e15c628e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:29.106638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-64ab95e2-9fad-4a83-a5b7-84b6e15c628e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:29.108642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d38b3-f879-4269-8a36-2114cb95ff62 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:29.109997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9f9d38b3-f879-4269-8a36-2114cb95ff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:29.164649 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d38b3-f879-4269-8a36-2114cb95ff62 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:29.168263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ca376-d6fd-47ff-b5cd-2ec2a8991485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:29.168904 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca376-d6fd-47ff-b5cd-2ec2a8991485 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:29.169023 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab95e2-9fad-4a83-a5b7-84b6e15c628e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:29.169180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca376-d6fd-47ff-b5cd-2ec2a8991485 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:29.169451 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca376-d6fd-47ff-b5cd-2ec2a8991485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:29.173691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:29.174590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:29.174874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:29.175155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] PATH_INFO: `/v3/users/495f484852cd48beb4719999a1026ea0` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:29.178109 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495f484852cd48beb4719999a1026ea0)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:29.179341 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:29.180625 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ca376-d6fd-47ff-b5cd-2ec2a8991485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:29.183055 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ca376-d6fd-47ff-b5cd-2ec2a8991485 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:29.201617 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1328/2676] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:29 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:45:29.227819 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495f484852cd48beb4719999a1026ea0'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:29.235293 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495f484852cd48beb4719999a1026ea0'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:29.235987 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495f484852cd48beb4719999a1026ea0'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:29.249199 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495f484852cd48beb4719999a1026ea0'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:29.249959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495f484852cd48beb4719999a1026ea0'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:29.264158 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1349/2677] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:29 2021] DELETE /identity/v3/users/495f484852cd48beb4719999a1026ea0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:29.269284 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae07c9-7373-44f0-b2c7-00a62ec866ad None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:29.269619 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae07c9-7373-44f0-b2c7-00a62ec866ad None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:29.270766 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae07c9-7373-44f0-b2c7-00a62ec866ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:29.289183 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-37ae07c9-7373-44f0-b2c7-00a62ec866ad None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:29.290517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-37ae07c9-7373-44f0-b2c7-00a62ec866ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:29.351175 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1329/2678] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:29.360963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:29.362802 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:29.428771 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6124a0-0aa4-4100-83f5-cd9dfcba9408 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:29.431142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca21935-7688-4777-9822-aebdd1c9c86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:29.431919 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21935-7688-4777-9822-aebdd1c9c86d service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:29.432234 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21935-7688-4777-9822-aebdd1c9c86d service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:29.432510 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21935-7688-4777-9822-aebdd1c9c86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:29.442972 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca21935-7688-4777-9822-aebdd1c9c86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:29.444394 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca21935-7688-4777-9822-aebdd1c9c86d service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:29.454433 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1350/2679] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:29.761195 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae07c9-7373-44f0-b2c7-00a62ec866ad None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:29.762949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-37ae07c9-7373-44f0-b2c7-00a62ec866ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:29.776904 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae07c9-7373-44f0-b2c7-00a62ec866ad None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:29.781687 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:29.782592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:29.782947 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:29.783226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] PATH_INFO: `/v3/projects/7d169c0306d0485a880d062bc3a6766f` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:29.784485 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d169c0306d0485a880d062bc3a6766f)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:29.787376 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:29.835253 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d169c0306d0485a880d062bc3a6766f', 'request_id': 'req-3e966415-b391-4c0c-9e69-c94d60518bc9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:29.842562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d169c0306d0485a880d062bc3a6766f', 'request_id': 'req-3e966415-b391-4c0c-9e69-c94d60518bc9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:29.850500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d169c0306d0485a880d062bc3a6766f', 'request_id': 'req-3e966415-b391-4c0c-9e69-c94d60518bc9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:29.863897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] The token cache is being invalidate because project 7d169c0306d0485a880d062bc3a6766f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:29.864182 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:29.864849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-3e966415-b391-4c0c-9e69-c94d60518bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:29.866436 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1330/2680] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:29 2021] DELETE /identity/v3/projects/7d169c0306d0485a880d062bc3a6766f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:29.872563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7688-88b9-4536-b93f-b7f3ea38372e None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:29.873072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7688-88b9-4536-b93f-b7f3ea38372e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:29.873226 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7688-88b9-4536-b93f-b7f3ea38372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:29.899094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e86e7688-88b9-4536-b93f-b7f3ea38372e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:29.900493 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e86e7688-88b9-4536-b93f-b7f3ea38372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:29.970485 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1351/2681] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:29.992286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56568cb8-070d-407b-b046-be4e8aefc35d None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:29.992782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56568cb8-070d-407b-b046-be4e8aefc35d None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:29.992886 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56568cb8-070d-407b-b046-be4e8aefc35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.021499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-56568cb8-070d-407b-b046-be4e8aefc35d None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:30.022790 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-56568cb8-070d-407b-b046-be4e8aefc35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:30.033828 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1331/2682] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:30.038459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e7688-88b9-4536-b93f-b7f3ea38372e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.050204 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e7688-88b9-4536-b93f-b7f3ea38372e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.057421 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f9023-0f21-44bd-b734-e86e7a9df0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.058506 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9023-0f21-44bd-b734-e86e7a9df0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.058648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9023-0f21-44bd-b734-e86e7a9df0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.059182 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9023-0f21-44bd-b734-e86e7a9df0f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.059814 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f9023-0f21-44bd-b734-e86e7a9df0f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:45:30.061412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f9023-0f21-44bd-b734-e86e7a9df0f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.063275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f9023-0f21-44bd-b734-e86e7a9df0f9 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.078522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1352/2683] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:45:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:45:30.083869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56568cb8-070d-407b-b046-be4e8aefc35d None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.093592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56568cb8-070d-407b-b046-be4e8aefc35d None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.098705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16dcb7-db1f-4c5e-876b-0ebbf62899d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.099626 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16dcb7-db1f-4c5e-876b-0ebbf62899d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.099907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16dcb7-db1f-4c5e-876b-0ebbf62899d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.100181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16dcb7-db1f-4c5e-876b-0ebbf62899d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.100884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16dcb7-db1f-4c5e-876b-0ebbf62899d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.102833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16dcb7-db1f-4c5e-876b-0ebbf62899d7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.131542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1332/2684] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:30 2021] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:30.136548 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f9023-0f21-44bd-b734-e86e7a9df0f9 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.148801 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f9023-0f21-44bd-b734-e86e7a9df0f9 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.216096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeb6b3-21b9-42db-8aec-faf8b9ba8c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.216096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeb6b3-21b9-42db-8aec-faf8b9ba8c77 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.216096 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeb6b3-21b9-42db-8aec-faf8b9ba8c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.216493 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeb6b3-21b9-42db-8aec-faf8b9ba8c77 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.216844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedeb6b3-21b9-42db-8aec-faf8b9ba8c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.218825 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedeb6b3-21b9-42db-8aec-faf8b9ba8c77 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.242507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1353/2685] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:30 2021] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:30.246761 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16dcb7-db1f-4c5e-876b-0ebbf62899d7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.258337 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16dcb7-db1f-4c5e-876b-0ebbf62899d7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.266747 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f22a5-c015-4c77-abed-806358042f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.267435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f22a5-c015-4c77-abed-806358042f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.267739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f22a5-c015-4c77-abed-806358042f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.268013 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f22a5-c015-4c77-abed-806358042f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.268781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f22a5-c015-4c77-abed-806358042f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.270458 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f22a5-c015-4c77-abed-806358042f30 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.283221 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1333/2686] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:30 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:30.287374 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeb6b3-21b9-42db-8aec-faf8b9ba8c77 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.298856 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeb6b3-21b9-42db-8aec-faf8b9ba8c77 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.304368 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e1129-d4c4-4494-9ef7-c1fed3313cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.305044 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e1129-d4c4-4494-9ef7-c1fed3313cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.305325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e1129-d4c4-4494-9ef7-c1fed3313cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.305598 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e1129-d4c4-4494-9ef7-c1fed3313cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.306367 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e1129-d4c4-4494-9ef7-c1fed3313cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.307999 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e1129-d4c4-4494-9ef7-c1fed3313cb5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.319517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1354/2687] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:30.323621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f22a5-c015-4c77-abed-806358042f30 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.334556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f22a5-c015-4c77-abed-806358042f30 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.339269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793bc9-b609-404f-881b-dec278d83c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.340160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793bc9-b609-404f-881b-dec278d83c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.340444 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793bc9-b609-404f-881b-dec278d83c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.340716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793bc9-b609-404f-881b-dec278d83c6d admin admin] PATH_INFO: `/v3/projects/80a6da0edd28443b931dd86bd7a5c3d0/users/52c98baee5a348039ee78b7c2fde84c6/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.357241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b793bc9-b609-404f-881b-dec278d83c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a6da0edd28443b931dd86bd7a5c3d0, user_id=52c98baee5a348039ee78b7c2fde84c6, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.360066 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b793bc9-b609-404f-881b-dec278d83c6d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.375132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1334/2688] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:30 2021] PUT /identity/v3/projects/80a6da0edd28443b931dd86bd7a5c3d0/users/52c98baee5a348039ee78b7c2fde84c6/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:30.392520 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f7138-82fd-4621-ad49-63272f084969 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.392884 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f7138-82fd-4621-ad49-63272f084969 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.393060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f7138-82fd-4621-ad49-63272f084969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.423373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-9c1f7138-82fd-4621-ad49-63272f084969 None None] MFA Rules not processed for user `52c98baee5a348039ee78b7c2fde84c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:30.424722 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9c1f7138-82fd-4621-ad49-63272f084969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:30.500815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1355/2689] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:30 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:30.505907 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793bc9-b609-404f-881b-dec278d83c6d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.578621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793bc9-b609-404f-881b-dec278d83c6d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.587421 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e7f4a-c61e-4e43-b9c0-10df3de8c57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.588282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e7f4a-c61e-4e43-b9c0-10df3de8c57e admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.588695 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e7f4a-c61e-4e43-b9c0-10df3de8c57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.588974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e7f4a-c61e-4e43-b9c0-10df3de8c57e admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.589694 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e7f4a-c61e-4e43-b9c0-10df3de8c57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.591763 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e7f4a-c61e-4e43-b9c0-10df3de8c57e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.603491 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f7138-82fd-4621-ad49-63272f084969 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.604908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9c1f7138-82fd-4621-ad49-63272f084969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:30.619594 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f7138-82fd-4621-ad49-63272f084969 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.622892 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1335/2690] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:30 2021] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:30.625070 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f8736-54ab-45e8-9b95-2c20013b5b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.630143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8736-54ab-45e8-9b95-2c20013b5b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.630143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8736-54ab-45e8-9b95-2c20013b5b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.630143 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8736-54ab-45e8-9b95-2c20013b5b1d admin admin] PATH_INFO: `/v3/users/af82aaf4288a415f9c5149a108817ccd` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.630853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e7f4a-c61e-4e43-b9c0-10df3de8c57e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.630981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f8736-54ab-45e8-9b95-2c20013b5b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af82aaf4288a415f9c5149a108817ccd)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.630981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f8736-54ab-45e8-9b95-2c20013b5b1d admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.684093 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-8c2f8736-54ab-45e8-9b95-2c20013b5b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af82aaf4288a415f9c5149a108817ccd'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:30.692798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-8c2f8736-54ab-45e8-9b95-2c20013b5b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af82aaf4288a415f9c5149a108817ccd'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:30.693522 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-8c2f8736-54ab-45e8-9b95-2c20013b5b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af82aaf4288a415f9c5149a108817ccd'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:30.696827 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e7f4a-c61e-4e43-b9c0-10df3de8c57e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.704561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870dcfb-fd02-47ba-b5f6-b2443210a466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.705547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870dcfb-fd02-47ba-b5f6-b2443210a466 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.705791 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-8c2f8736-54ab-45e8-9b95-2c20013b5b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af82aaf4288a415f9c5149a108817ccd'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:30.705895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870dcfb-fd02-47ba-b5f6-b2443210a466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.706151 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870dcfb-fd02-47ba-b5f6-b2443210a466 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.706514 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-8c2f8736-54ab-45e8-9b95-2c20013b5b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af82aaf4288a415f9c5149a108817ccd'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:30.706835 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870dcfb-fd02-47ba-b5f6-b2443210a466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.709297 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870dcfb-fd02-47ba-b5f6-b2443210a466 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.722316 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1356/2691] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:30 2021] DELETE /identity/v3/users/af82aaf4288a415f9c5149a108817ccd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:30.727659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94933af-be7e-4062-981d-88b2b2d47973 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.728024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94933af-be7e-4062-981d-88b2b2d47973 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.728378 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94933af-be7e-4062-981d-88b2b2d47973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.732247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1336/2692] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:30 2021] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:30.736185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870dcfb-fd02-47ba-b5f6-b2443210a466 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.738496 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-8870dcfb-fd02-47ba-b5f6-b2443210a466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:30.747428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-e94933af-be7e-4062-981d-88b2b2d47973 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:30.748641 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e94933af-be7e-4062-981d-88b2b2d47973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:30.751368 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870dcfb-fd02-47ba-b5f6-b2443210a466 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.812276 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b8b68-4f1d-4077-866b-5410213cb280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.812964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b8b68-4f1d-4077-866b-5410213cb280 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.813129 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1357/2693] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:30.814036 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b8b68-4f1d-4077-866b-5410213cb280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.814403 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b8b68-4f1d-4077-866b-5410213cb280 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.815211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b8b68-4f1d-4077-866b-5410213cb280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.817473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b8b68-4f1d-4077-866b-5410213cb280 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.823289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94933af-be7e-4062-981d-88b2b2d47973 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.824713 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e94933af-be7e-4062-981d-88b2b2d47973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:30.829110 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1337/2694] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:30 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:45:30.833361 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b8b68-4f1d-4077-866b-5410213cb280 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.843288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b8b68-4f1d-4077-866b-5410213cb280 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.850052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff238-3f4c-4419-85c0-a86bdfdc1028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.850728 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff238-3f4c-4419-85c0-a86bdfdc1028 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.851011 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff238-3f4c-4419-85c0-a86bdfdc1028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.851287 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff238-3f4c-4419-85c0-a86bdfdc1028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.852027 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff238-3f4c-4419-85c0-a86bdfdc1028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.853669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff238-3f4c-4419-85c0-a86bdfdc1028 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.864996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1338/2695] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:30.869202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff238-3f4c-4419-85c0-a86bdfdc1028 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:30.878949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff238-3f4c-4419-85c0-a86bdfdc1028 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.883922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972a8f2-6a34-4543-abb5-d9f0e0c8be6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.884814 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972a8f2-6a34-4543-abb5-d9f0e0c8be6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.885100 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972a8f2-6a34-4543-abb5-d9f0e0c8be6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.885375 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972a8f2-6a34-4543-abb5-d9f0e0c8be6f admin admin] PATH_INFO: `/v3/projects/6ced9c22670b43a8b52c776b69dbe6d7/users/0f356496de824d24bdd59a56e6fd6131/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.888959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94933af-be7e-4062-981d-88b2b2d47973 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:30.892774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddccc3-0870-4c53-b1f0-6521fa3631c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:30.893408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddccc3-0870-4c53-b1f0-6521fa3631c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.893941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddccc3-0870-4c53-b1f0-6521fa3631c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.894064 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddccc3-0870-4c53-b1f0-6521fa3631c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.901961 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972a8f2-6a34-4543-abb5-d9f0e0c8be6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ced9c22670b43a8b52c776b69dbe6d7, user_id=0f356496de824d24bdd59a56e6fd6131, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.903649 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddccc3-0870-4c53-b1f0-6521fa3631c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:30.904624 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972a8f2-6a34-4543-abb5-d9f0e0c8be6f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.905271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddccc3-0870-4c53-b1f0-6521fa3631c9 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:30.916586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1358/2696] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:45:30.920778 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1339/2697] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:30 2021] PUT /identity/v3/projects/6ced9c22670b43a8b52c776b69dbe6d7/users/0f356496de824d24bdd59a56e6fd6131/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:30.932853 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf251b-4100-4ed2-afa3-76a9cb1050c7 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:30.933150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf251b-4100-4ed2-afa3-76a9cb1050c7 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:30.933429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf251b-4100-4ed2-afa3-76a9cb1050c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:30.961017 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-c8bf251b-4100-4ed2-afa3-76a9cb1050c7 None None] MFA Rules not processed for user `0f356496de824d24bdd59a56e6fd6131`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:30.962288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-c8bf251b-4100-4ed2-afa3-76a9cb1050c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:31.032775 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1359/2698] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:30 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:31.041111 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972a8f2-6a34-4543-abb5-d9f0e0c8be6f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:31.111223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972a8f2-6a34-4543-abb5-d9f0e0c8be6f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:31.116497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ad1b8-32c4-450c-9f06-29a219ca7a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:31.117164 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad1b8-32c4-450c-9f06-29a219ca7a45 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:31.117438 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad1b8-32c4-450c-9f06-29a219ca7a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:31.118421 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad1b8-32c4-450c-9f06-29a219ca7a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:31.118421 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ad1b8-32c4-450c-9f06-29a219ca7a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:31.120319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ad1b8-32c4-450c-9f06-29a219ca7a45 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:31.147276 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1340/2699] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:31 2021] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:31.151562 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf251b-4100-4ed2-afa3-76a9cb1050c7 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:31.164231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf251b-4100-4ed2-afa3-76a9cb1050c7 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:31.215336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ad1b8-32c4-450c-9f06-29a219ca7a45 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:31.217522 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e81ad1b8-32c4-450c-9f06-29a219ca7a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:31.235873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c1b1-5063-4727-83c2-b0c3a9a91bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:31.237420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c1b1-5063-4727-83c2-b0c3a9a91bea admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:31.238244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c1b1-5063-4727-83c2-b0c3a9a91bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:31.239024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c1b1-5063-4727-83c2-b0c3a9a91bea admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:31.240621 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c1b1-5063-4727-83c2-b0c3a9a91bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:31.245296 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c1b1-5063-4727-83c2-b0c3a9a91bea admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:31.274037 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1360/2700] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:31 2021] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:31.275462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c1b1-5063-4727-83c2-b0c3a9a91bea admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:31.287857 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c1b1-5063-4727-83c2-b0c3a9a91bea admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:31.293340 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867872c3-112f-4c69-b4f5-713d161a28b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:31.294053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867872c3-112f-4c69-b4f5-713d161a28b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:31.294352 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867872c3-112f-4c69-b4f5-713d161a28b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:31.294657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867872c3-112f-4c69-b4f5-713d161a28b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:31.295463 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867872c3-112f-4c69-b4f5-713d161a28b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:31.297105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867872c3-112f-4c69-b4f5-713d161a28b2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:31.299420 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ad1b8-32c4-450c-9f06-29a219ca7a45 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:31.304206 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:31.305222 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:31.305521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:31.305816 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] PATH_INFO: `/v3/projects/e1e3b22e5dec4def9d67933e8d731236` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:31.307014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e3b22e5dec4def9d67933e8d731236)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:31.307678 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1361/2701] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:45:31.308943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:31.311807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867872c3-112f-4c69-b4f5-713d161a28b2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:31.321574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867872c3-112f-4c69-b4f5-713d161a28b2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:31.326715 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba8f62-d174-4899-a3e9-52751ac4d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:31.327624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8f62-d174-4899-a3e9-52751ac4d208 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:31.327905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8f62-d174-4899-a3e9-52751ac4d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:31.328176 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8f62-d174-4899-a3e9-52751ac4d208 admin admin] PATH_INFO: `/v3/projects/504cd965c0b54584a3ef82c0196f21c6/users/dc7818dec23b4d808b238834bf6a95d1/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:31.344089 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba8f62-d174-4899-a3e9-52751ac4d208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504cd965c0b54584a3ef82c0196f21c6, user_id=dc7818dec23b4d808b238834bf6a95d1, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:31.346776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba8f62-d174-4899-a3e9-52751ac4d208 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:31.354949 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e3b22e5dec4def9d67933e8d731236', 'request_id': 'req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:31.360757 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1362/2702] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:31 2021] PUT /identity/v3/projects/504cd965c0b54584a3ef82c0196f21c6/users/dc7818dec23b4d808b238834bf6a95d1/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:31.361062 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e3b22e5dec4def9d67933e8d731236', 'request_id': 'req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:31.364784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba8f62-d174-4899-a3e9-52751ac4d208 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:31.368012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e3b22e5dec4def9d67933e8d731236', 'request_id': 'req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:31.378229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] The token cache is being invalidate because project e1e3b22e5dec4def9d67933e8d731236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:31.378509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:31.379148 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:31.381539 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1341/2703] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:31 2021] DELETE /identity/v3/projects/e1e3b22e5dec4def9d67933e8d731236 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:31.386006 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:31.387470 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:31.429480 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba8f62-d174-4899-a3e9-52751ac4d208 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:31.434690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444180-7df2-4b26-b4bd-9f3e013c14a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:31.435612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444180-7df2-4b26-b4bd-9f3e013c14a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:31.435971 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444180-7df2-4b26-b4bd-9f3e013c14a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:31.436251 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444180-7df2-4b26-b4bd-9f3e013c14a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:31.436988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca444180-7df2-4b26-b4bd-9f3e013c14a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:31.438608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca444180-7df2-4b26-b4bd-9f3e013c14a0 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:31.449060 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1363/2704] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:31 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:45:31.452434 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01afc8f-0cb3-4ee4-b8c4-79dd625089fa admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:31.453357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444180-7df2-4b26-b4bd-9f3e013c14a0 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:31.455146 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ca444180-7df2-4b26-b4bd-9f3e013c14a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:31.457408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:31.458896 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:31.459234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:31.459464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] PATH_INFO: `/v3/users/90e22fe8e710412391293448247cbc7e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:31.460751 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e22fe8e710412391293448247cbc7e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:31.462781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:31.470201 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444180-7df2-4b26-b4bd-9f3e013c14a0 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:31.476975 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbef00-964b-43a8-8605-f9c1050c68a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:31.477878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbef00-964b-43a8-8605-f9c1050c68a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:31.478155 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbef00-964b-43a8-8605-f9c1050c68a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:31.478429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbef00-964b-43a8-8605-f9c1050c68a6 admin admin] PATH_INFO: `/v3/projects/504cd965c0b54584a3ef82c0196f21c6/users/dc7818dec23b4d808b238834bf6a95d1/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:31.480459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbef00-964b-43a8-8605-f9c1050c68a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504cd965c0b54584a3ef82c0196f21c6, user_id=dc7818dec23b4d808b238834bf6a95d1, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:31.483131 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbef00-964b-43a8-8605-f9c1050c68a6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:31.496006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1364/2705] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:31 2021] PUT /identity/v3/projects/504cd965c0b54584a3ef82c0196f21c6/users/dc7818dec23b4d808b238834bf6a95d1/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:31.508163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffcc04-9d8d-4df1-bfeb-4ab1722242ef None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:31.508432 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffcc04-9d8d-4df1-bfeb-4ab1722242ef None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:31.508706 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffcc04-9d8d-4df1-bfeb-4ab1722242ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:31.516387 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e22fe8e710412391293448247cbc7e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:31.525621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e22fe8e710412391293448247cbc7e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:31.533191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e22fe8e710412391293448247cbc7e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:31.536801 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-6cffcc04-9d8d-4df1-bfeb-4ab1722242ef None None] MFA Rules not processed for user `dc7818dec23b4d808b238834bf6a95d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:31.538113 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6cffcc04-9d8d-4df1-bfeb-4ab1722242ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:31.545571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e22fe8e710412391293448247cbc7e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:31.546389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e22fe8e710412391293448247cbc7e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:31.552818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1342/2706] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:31 2021] DELETE /identity/v3/users/90e22fe8e710412391293448247cbc7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:31.610762 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1365/2707] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:31 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:31.622070 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:31.623499 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:31.681930 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e91f6-05db-47e9-bd4a-97b73d2d3019 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:31.685561 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ac6dc-73d8-4695-a234-f2d3c3dc46a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:31.686237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac6dc-73d8-4695-a234-f2d3c3dc46a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:31.686516 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac6dc-73d8-4695-a234-f2d3c3dc46a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:31.686786 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac6dc-73d8-4695-a234-f2d3c3dc46a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:31.688598 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-435ac6dc-73d8-4695-a234-f2d3c3dc46a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:31.751347 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ac6dc-73d8-4695-a234-f2d3c3dc46a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:31.753304 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ac6dc-73d8-4695-a234-f2d3c3dc46a3 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:31.762741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1343/2708] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:31 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:31.830019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffcc04-9d8d-4df1-bfeb-4ab1722242ef None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:31.831674 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-6cffcc04-9d8d-4df1-bfeb-4ab1722242ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:31.904209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffcc04-9d8d-4df1-bfeb-4ab1722242ef None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:31.959388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:31.960481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:31.961108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:31.961108 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] PATH_INFO: `/v3/projects/2f5fcd7ac73b40329303364c0a38dba8` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:31.962475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5fcd7ac73b40329303364c0a38dba8)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:31.964428 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.021806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5fcd7ac73b40329303364c0a38dba8', 'request_id': 'req-3c54185e-31c4-4952-820a-5ade36925d6e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:32.028940 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5fcd7ac73b40329303364c0a38dba8', 'request_id': 'req-3c54185e-31c4-4952-820a-5ade36925d6e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:32.037698 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5fcd7ac73b40329303364c0a38dba8', 'request_id': 'req-3c54185e-31c4-4952-820a-5ade36925d6e'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:32.049810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] The token cache is being invalidate because project 2f5fcd7ac73b40329303364c0a38dba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:32.049810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:32.051087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-3c54185e-31c4-4952-820a-5ade36925d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:32.052665 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1366/2709] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:31 2021] DELETE /identity/v3/projects/2f5fcd7ac73b40329303364c0a38dba8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:32.058458 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59462864-c093-4738-a4e4-2f8c6839a61a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.058957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59462864-c093-4738-a4e4-2f8c6839a61a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.059127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59462864-c093-4738-a4e4-2f8c6839a61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.078087 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-59462864-c093-4738-a4e4-2f8c6839a61a None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:32.079371 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-59462864-c093-4738-a4e4-2f8c6839a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:32.139105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1344/2710] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:32.147761 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63872-f451-460e-8bb8-32a71ce91251 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.148042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63872-f451-460e-8bb8-32a71ce91251 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.148314 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63872-f451-460e-8bb8-32a71ce91251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.166277 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-dad63872-f451-460e-8bb8-32a71ce91251 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:32.167466 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-dad63872-f451-460e-8bb8-32a71ce91251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:32.175406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1367/2711] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:32.179748 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59462864-c093-4738-a4e4-2f8c6839a61a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.189307 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59462864-c093-4738-a4e4-2f8c6839a61a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.194822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce39e9-fee3-4409-b869-f575a1bb9e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.195485 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce39e9-fee3-4409-b869-f575a1bb9e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.195767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce39e9-fee3-4409-b869-f575a1bb9e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.196042 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce39e9-fee3-4409-b869-f575a1bb9e1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.196787 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce39e9-fee3-4409-b869-f575a1bb9e1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:45:32.197092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce39e9-fee3-4409-b869-f575a1bb9e1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.198745 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce39e9-fee3-4409-b869-f575a1bb9e1b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.211545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1345/2712] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:45:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:45:32.215278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad63872-f451-460e-8bb8-32a71ce91251 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.225025 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad63872-f451-460e-8bb8-32a71ce91251 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.229917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd313d-a7a3-43b1-b2ba-6a89de176afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.230579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd313d-a7a3-43b1-b2ba-6a89de176afd admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.230859 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd313d-a7a3-43b1-b2ba-6a89de176afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.231134 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd313d-a7a3-43b1-b2ba-6a89de176afd admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.231840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd313d-a7a3-43b1-b2ba-6a89de176afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.233772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd313d-a7a3-43b1-b2ba-6a89de176afd admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.260106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1368/2713] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:32 2021] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:32.264572 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce39e9-fee3-4409-b869-f575a1bb9e1b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.275822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce39e9-fee3-4409-b869-f575a1bb9e1b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.330643 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cc195-2142-452d-abce-65c9b3d58936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.331219 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cc195-2142-452d-abce-65c9b3d58936 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.331527 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cc195-2142-452d-abce-65c9b3d58936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.331797 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cc195-2142-452d-abce-65c9b3d58936 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.332494 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cc195-2142-452d-abce-65c9b3d58936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.334990 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cc195-2142-452d-abce-65c9b3d58936 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.354533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1346/2714] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:32 2021] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:32.360173 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd313d-a7a3-43b1-b2ba-6a89de176afd admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.370467 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd313d-a7a3-43b1-b2ba-6a89de176afd admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.375077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce86d35-ae78-4b7b-ac57-431533b914de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.375728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86d35-ae78-4b7b-ac57-431533b914de admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.376009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86d35-ae78-4b7b-ac57-431533b914de admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.376283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86d35-ae78-4b7b-ac57-431533b914de admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.377038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce86d35-ae78-4b7b-ac57-431533b914de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.378650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce86d35-ae78-4b7b-ac57-431533b914de admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.389543 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1369/2715] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:32.393676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cc195-2142-452d-abce-65c9b3d58936 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.404050 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cc195-2142-452d-abce-65c9b3d58936 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.408614 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce348a-a531-46a7-bc4d-ae38b602734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.409256 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce348a-a531-46a7-bc4d-ae38b602734d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.409531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce348a-a531-46a7-bc4d-ae38b602734d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.409825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce348a-a531-46a7-bc4d-ae38b602734d admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.410552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce348a-a531-46a7-bc4d-ae38b602734d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.412223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce348a-a531-46a7-bc4d-ae38b602734d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.421819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1347/2716] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:32.425695 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce86d35-ae78-4b7b-ac57-431533b914de admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.435465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce86d35-ae78-4b7b-ac57-431533b914de admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.440205 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4ea7-eae6-4cdc-b4fc-000b22238d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.441075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4ea7-eae6-4cdc-b4fc-000b22238d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.441356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4ea7-eae6-4cdc-b4fc-000b22238d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.441632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4ea7-eae6-4cdc-b4fc-000b22238d77 admin admin] PATH_INFO: `/v3/projects/fe0147cf5c914272bee1c7366e21cda7/users/319aa7d920f941d08023e7d93fbcc7f9/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.456596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4ea7-eae6-4cdc-b4fc-000b22238d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0147cf5c914272bee1c7366e21cda7, user_id=319aa7d920f941d08023e7d93fbcc7f9, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.460030 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4ea7-eae6-4cdc-b4fc-000b22238d77 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.472874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1370/2717] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:32 2021] PUT /identity/v3/projects/fe0147cf5c914272bee1c7366e21cda7/users/319aa7d920f941d08023e7d93fbcc7f9/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:32.483228 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6001-106d-4130-9da4-0e5561d18167 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.483563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6001-106d-4130-9da4-0e5561d18167 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.483865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6001-106d-4130-9da4-0e5561d18167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.510588 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-11ff6001-106d-4130-9da4-0e5561d18167 None None] MFA Rules not processed for user `319aa7d920f941d08023e7d93fbcc7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:32.511781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-11ff6001-106d-4130-9da4-0e5561d18167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:32.578681 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1348/2718] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:32 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:32.583361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4ea7-eae6-4cdc-b4fc-000b22238d77 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.643382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4ea7-eae6-4cdc-b4fc-000b22238d77 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.648081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718ca3b-3c53-42f4-8bed-b322a7b9bb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.648733 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718ca3b-3c53-42f4-8bed-b322a7b9bb55 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.649028 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718ca3b-3c53-42f4-8bed-b322a7b9bb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.649283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718ca3b-3c53-42f4-8bed-b322a7b9bb55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.650014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718ca3b-3c53-42f4-8bed-b322a7b9bb55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.651911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718ca3b-3c53-42f4-8bed-b322a7b9bb55 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.677303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1371/2719] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:32 2021] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:32.681346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6001-106d-4130-9da4-0e5561d18167 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.692635 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6001-106d-4130-9da4-0e5561d18167 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.746641 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b5c6-ce49-4af6-992c-e087fb2c48ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.747307 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b5c6-ce49-4af6-992c-e087fb2c48ab admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.747593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b5c6-ce49-4af6-992c-e087fb2c48ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.747865 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b5c6-ce49-4af6-992c-e087fb2c48ab admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.748563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279b5c6-ce49-4af6-992c-e087fb2c48ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.750505 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279b5c6-ce49-4af6-992c-e087fb2c48ab admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.769883 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1349/2720] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:32 2021] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:32.774207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718ca3b-3c53-42f4-8bed-b322a7b9bb55 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.784761 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718ca3b-3c53-42f4-8bed-b322a7b9bb55 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.789326 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50ec6-6336-4e3e-be29-19d4b7c1aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.790010 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50ec6-6336-4e3e-be29-19d4b7c1aabf admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.790311 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50ec6-6336-4e3e-be29-19d4b7c1aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.790568 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50ec6-6336-4e3e-be29-19d4b7c1aabf admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.791318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f50ec6-6336-4e3e-be29-19d4b7c1aabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.793032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f50ec6-6336-4e3e-be29-19d4b7c1aabf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.803790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1372/2721] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:32.807848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b5c6-ce49-4af6-992c-e087fb2c48ab admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.818105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b5c6-ce49-4af6-992c-e087fb2c48ab admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.822683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544c09d-4e3a-4711-b6f3-c331b1afe500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.823642 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c09d-4e3a-4711-b6f3-c331b1afe500 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.823924 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c09d-4e3a-4711-b6f3-c331b1afe500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.824216 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c09d-4e3a-4711-b6f3-c331b1afe500 admin admin] PATH_INFO: `/v3/projects/b4b34e5320be4adb86dad15dba23f01a/users/890bae9defc64ec1acde0d34f115ba78/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.838866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544c09d-4e3a-4711-b6f3-c331b1afe500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b34e5320be4adb86dad15dba23f01a, user_id=890bae9defc64ec1acde0d34f115ba78, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.841442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544c09d-4e3a-4711-b6f3-c331b1afe500 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.854906 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1350/2722] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:32 2021] PUT /identity/v3/projects/b4b34e5320be4adb86dad15dba23f01a/users/890bae9defc64ec1acde0d34f115ba78/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:32.858743 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50ec6-6336-4e3e-be29-19d4b7c1aabf admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.869153 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50ec6-6336-4e3e-be29-19d4b7c1aabf admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.922338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42703346-029f-4e2e-b454-c80c74d52e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.922995 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42703346-029f-4e2e-b454-c80c74d52e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.923258 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42703346-029f-4e2e-b454-c80c74d52e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.923533 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42703346-029f-4e2e-b454-c80c74d52e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.924252 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42703346-029f-4e2e-b454-c80c74d52e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.925844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42703346-029f-4e2e-b454-c80c74d52e51 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.936006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1373/2723] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:32 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:32.940273 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544c09d-4e3a-4711-b6f3-c331b1afe500 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:32.950226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544c09d-4e3a-4711-b6f3-c331b1afe500 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:32.954959 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743864d1-deda-4bc4-b461-2b3fa89a23a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:32.955879 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743864d1-deda-4bc4-b461-2b3fa89a23a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.956475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743864d1-deda-4bc4-b461-2b3fa89a23a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.956475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743864d1-deda-4bc4-b461-2b3fa89a23a7 admin admin] PATH_INFO: `/v3/projects/b4b34e5320be4adb86dad15dba23f01a/users/890bae9defc64ec1acde0d34f115ba78/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:32.958501 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743864d1-deda-4bc4-b461-2b3fa89a23a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b34e5320be4adb86dad15dba23f01a, user_id=890bae9defc64ec1acde0d34f115ba78, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:32.961141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743864d1-deda-4bc4-b461-2b3fa89a23a7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:32.971209 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1351/2724] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:32 2021] PUT /identity/v3/projects/b4b34e5320be4adb86dad15dba23f01a/users/890bae9defc64ec1acde0d34f115ba78/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:32.981776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0227ac-ce6a-4326-8bf8-48a423d7a3d8 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:32.982073 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0227ac-ce6a-4326-8bf8-48a423d7a3d8 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:32.982351 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0227ac-ce6a-4326-8bf8-48a423d7a3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:33.008525 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-8a0227ac-ce6a-4326-8bf8-48a423d7a3d8 None None] MFA Rules not processed for user `890bae9defc64ec1acde0d34f115ba78`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:33.009714 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8a0227ac-ce6a-4326-8bf8-48a423d7a3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:33.076758 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1374/2725] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:32 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:33.087028 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743864d1-deda-4bc4-b461-2b3fa89a23a7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:33.089129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-743864d1-deda-4bc4-b461-2b3fa89a23a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:33.149160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743864d1-deda-4bc4-b461-2b3fa89a23a7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:33.152857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e8db7-e58e-4d49-9a14-9a031efc8d0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:33.153497 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e8db7-e58e-4d49-9a14-9a031efc8d0f service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:33.153798 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e8db7-e58e-4d49-9a14-9a031efc8d0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:33.154078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e8db7-e58e-4d49-9a14-9a031efc8d0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:33.163859 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e8db7-e58e-4d49-9a14-9a031efc8d0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:33.165309 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e8db7-e58e-4d49-9a14-9a031efc8d0f service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:33.174737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1352/2726] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:33 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:33.203495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0227ac-ce6a-4326-8bf8-48a423d7a3d8 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:33.235359 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e8db7-e58e-4d49-9a14-9a031efc8d0f service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:33.236820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-552e8db7-e58e-4d49-9a14-9a031efc8d0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:33.248369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e8db7-e58e-4d49-9a14-9a031efc8d0f service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:33.252038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059ee84-6550-4c72-95d3-ec1ba79e394b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:33.252666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ee84-6550-4c72-95d3-ec1ba79e394b service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:33.252941 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ee84-6550-4c72-95d3-ec1ba79e394b service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:33.253237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ee84-6550-4c72-95d3-ec1ba79e394b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:33.255058 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a059ee84-6550-4c72-95d3-ec1ba79e394b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:33.274148 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0227ac-ce6a-4326-8bf8-48a423d7a3d8 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:33.279439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:33.280324 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:33.280585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:33.280858 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] PATH_INFO: `/v3/users/319aa7d920f941d08023e7d93fbcc7f9` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:33.282272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=319aa7d920f941d08023e7d93fbcc7f9)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:33.284212 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:33.314816 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059ee84-6550-4c72-95d3-ec1ba79e394b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:33.316239 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059ee84-6550-4c72-95d3-ec1ba79e394b service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:33.325052 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1353/2727] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:33 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:45:33.331970 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '319aa7d920f941d08023e7d93fbcc7f9'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:33.339965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '319aa7d920f941d08023e7d93fbcc7f9'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:33.340591 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '319aa7d920f941d08023e7d93fbcc7f9'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:33.353690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '319aa7d920f941d08023e7d93fbcc7f9'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:33.354514 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '319aa7d920f941d08023e7d93fbcc7f9'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:33.367496 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1375/2728] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:33 2021] DELETE /identity/v3/users/319aa7d920f941d08023e7d93fbcc7f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:33.372118 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde1b67-a0b2-4def-85a9-9af17cfeedef None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:33.372412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde1b67-a0b2-4def-85a9-9af17cfeedef None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:33.372689 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde1b67-a0b2-4def-85a9-9af17cfeedef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:33.391089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-dbde1b67-a0b2-4def-85a9-9af17cfeedef None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:33.392384 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-dbde1b67-a0b2-4def-85a9-9af17cfeedef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:33.456325 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1354/2729] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:33.468035 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:33.470569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:33.538038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b126d81-e8bd-4926-8f4c-f094863e02cf admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:33.541800 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7f03-27ce-4f7d-9476-cec38d4bcd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:33.542528 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7f03-27ce-4f7d-9476-cec38d4bcd92 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:33.542805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7f03-27ce-4f7d-9476-cec38d4bcd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:33.543083 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7f03-27ce-4f7d-9476-cec38d4bcd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:33.552529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de7f03-27ce-4f7d-9476-cec38d4bcd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:33.554146 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de7f03-27ce-4f7d-9476-cec38d4bcd92 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:33.564429 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1376/2730] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:33.838121 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde1b67-a0b2-4def-85a9-9af17cfeedef None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:33.839603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-dbde1b67-a0b2-4def-85a9-9af17cfeedef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:33.850917 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7f03-27ce-4f7d-9476-cec38d4bcd92 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:33.852883 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-44de7f03-27ce-4f7d-9476-cec38d4bcd92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:33.866517 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7f03-27ce-4f7d-9476-cec38d4bcd92 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:33.871504 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:33.872386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:33.872663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:33.872956 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] PATH_INFO: `/v3/projects/fe0147cf5c914272bee1c7366e21cda7` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:33.875046 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0147cf5c914272bee1c7366e21cda7)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:33.877040 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:33.902902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde1b67-a0b2-4def-85a9-9af17cfeedef None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:33.907601 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a7f4b-2e47-4cc3-baab-c8514f3cdea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:33.908511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a7f4b-2e47-4cc3-baab-c8514f3cdea9 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:33.908833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a7f4b-2e47-4cc3-baab-c8514f3cdea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:33.909385 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a7f4b-2e47-4cc3-baab-c8514f3cdea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:33.911453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-960a7f4b-2e47-4cc3-baab-c8514f3cdea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:33.927262 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0147cf5c914272bee1c7366e21cda7', 'request_id': 'req-74960f54-c56d-4328-b7ae-a8cd88b83134'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:33.933242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0147cf5c914272bee1c7366e21cda7', 'request_id': 'req-74960f54-c56d-4328-b7ae-a8cd88b83134'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:33.939911 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0147cf5c914272bee1c7366e21cda7', 'request_id': 'req-74960f54-c56d-4328-b7ae-a8cd88b83134'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:33.950208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] The token cache is being invalidate because project fe0147cf5c914272bee1c7366e21cda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:33.950491 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:33.951123 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:33.952635 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1377/2731] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:33 2021] DELETE /identity/v3/projects/fe0147cf5c914272bee1c7366e21cda7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:33.956348 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:33.957633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:33.978089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a7f4b-2e47-4cc3-baab-c8514f3cdea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:33.980460 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a7f4b-2e47-4cc3-baab-c8514f3cdea9 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:33.990866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1355/2732] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:33 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:34.028900 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74960f54-c56d-4328-b7ae-a8cd88b83134 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:34.034320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452a5b9-34df-413a-baaf-db4628c4c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:34.035350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452a5b9-34df-413a-baaf-db4628c4c0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:34.036546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452a5b9-34df-413a-baaf-db4628c4c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:34.036546 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452a5b9-34df-413a-baaf-db4628c4c0bd admin admin] PATH_INFO: `/v3/users/890bae9defc64ec1acde0d34f115ba78` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:34.037620 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452a5b9-34df-413a-baaf-db4628c4c0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=890bae9defc64ec1acde0d34f115ba78)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:34.039679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452a5b9-34df-413a-baaf-db4628c4c0bd admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:34.089085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4452a5b9-34df-413a-baaf-db4628c4c0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890bae9defc64ec1acde0d34f115ba78'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:34.103289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4452a5b9-34df-413a-baaf-db4628c4c0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890bae9defc64ec1acde0d34f115ba78'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:34.103289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4452a5b9-34df-413a-baaf-db4628c4c0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890bae9defc64ec1acde0d34f115ba78'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:34.109612 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4452a5b9-34df-413a-baaf-db4628c4c0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890bae9defc64ec1acde0d34f115ba78'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:34.110302 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-4452a5b9-34df-413a-baaf-db4628c4c0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890bae9defc64ec1acde0d34f115ba78'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:34.122981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1378/2733] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:33 2021] DELETE /identity/v3/users/890bae9defc64ec1acde0d34f115ba78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:34.385218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a7f4b-2e47-4cc3-baab-c8514f3cdea9 service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:34.399075 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a7f4b-2e47-4cc3-baab-c8514f3cdea9 service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:34.453435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:34.454322 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:34.454595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:34.454863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] PATH_INFO: `/v3/projects/b4b34e5320be4adb86dad15dba23f01a` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:34.456066 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b34e5320be4adb86dad15dba23f01a)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:34.458637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:34.502996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b34e5320be4adb86dad15dba23f01a', 'request_id': 'req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:34.509750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b34e5320be4adb86dad15dba23f01a', 'request_id': 'req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:34.517537 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b34e5320be4adb86dad15dba23f01a', 'request_id': 'req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:34.528799 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] The token cache is being invalidate because project b4b34e5320be4adb86dad15dba23f01a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:34.529086 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:34.529723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-498cfefd-9e61-4ff5-b53f-07e93f2f2b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:34.531338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1356/2734] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:34 2021] DELETE /identity/v3/projects/b4b34e5320be4adb86dad15dba23f01a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:34.537036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc838c79-d536-4305-b929-e2272f3da80e None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:34.537349 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc838c79-d536-4305-b929-e2272f3da80e None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:34.537625 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc838c79-d536-4305-b929-e2272f3da80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:34.555820 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-cc838c79-d536-4305-b929-e2272f3da80e None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:34.557009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-cc838c79-d536-4305-b929-e2272f3da80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:34.615667 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1379/2735] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:34.624655 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4cf20-5284-41f2-bdeb-9cb54aed2244 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:34.624941 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4cf20-5284-41f2-bdeb-9cb54aed2244 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:34.625215 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4cf20-5284-41f2-bdeb-9cb54aed2244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:34.644044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-93e4cf20-5284-41f2-bdeb-9cb54aed2244 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:34.646015 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-93e4cf20-5284-41f2-bdeb-9cb54aed2244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:34.654042 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1357/2736] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:34.658368 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc838c79-d536-4305-b929-e2272f3da80e None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:34.669246 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc838c79-d536-4305-b929-e2272f3da80e None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:34.673991 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a1c74-4b70-4e98-be30-0bcb9dfea5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:34.674648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1c74-4b70-4e98-be30-0bcb9dfea5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:34.674929 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1c74-4b70-4e98-be30-0bcb9dfea5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:34.675223 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1c74-4b70-4e98-be30-0bcb9dfea5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:34.675954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1c74-4b70-4e98-be30-0bcb9dfea5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:45:34.676259 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1c74-4b70-4e98-be30-0bcb9dfea5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:34.678590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1c74-4b70-4e98-be30-0bcb9dfea5b2 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:34.690120 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1380/2737] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:45:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:45:34.694549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4cf20-5284-41f2-bdeb-9cb54aed2244 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:34.704205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4cf20-5284-41f2-bdeb-9cb54aed2244 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:34.708869 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3166d0-1110-49ea-9ccb-1daf38b24240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:34.709514 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3166d0-1110-49ea-9ccb-1daf38b24240 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:34.709818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3166d0-1110-49ea-9ccb-1daf38b24240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:34.710088 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3166d0-1110-49ea-9ccb-1daf38b24240 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:34.710788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3166d0-1110-49ea-9ccb-1daf38b24240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:34.712668 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3166d0-1110-49ea-9ccb-1daf38b24240 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:34.738956 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1358/2738] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:34 2021] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:34.743178 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a1c74-4b70-4e98-be30-0bcb9dfea5b2 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:34.753032 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a1c74-4b70-4e98-be30-0bcb9dfea5b2 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:34.808231 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e9b36-3c06-4b21-b983-aca0c136bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:34.808891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9b36-3c06-4b21-b983-aca0c136bd61 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:34.809171 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9b36-3c06-4b21-b983-aca0c136bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:34.809444 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9b36-3c06-4b21-b983-aca0c136bd61 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:34.810185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e9b36-3c06-4b21-b983-aca0c136bd61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:34.812106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e9b36-3c06-4b21-b983-aca0c136bd61 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:34.833964 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1381/2739] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:34 2021] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:34.838161 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3166d0-1110-49ea-9ccb-1daf38b24240 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:34.851735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3166d0-1110-49ea-9ccb-1daf38b24240 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:34.857061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf116c-1cb0-4de4-bc2e-2eb5ad1b6443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:34.857718 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf116c-1cb0-4de4-bc2e-2eb5ad1b6443 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:34.858024 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf116c-1cb0-4de4-bc2e-2eb5ad1b6443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:34.858294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf116c-1cb0-4de4-bc2e-2eb5ad1b6443 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:34.859022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf116c-1cb0-4de4-bc2e-2eb5ad1b6443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:34.860590 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf116c-1cb0-4de4-bc2e-2eb5ad1b6443 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:34.871023 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1359/2740] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:34.874984 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e9b36-3c06-4b21-b983-aca0c136bd61 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:34.885474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e9b36-3c06-4b21-b983-aca0c136bd61 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:34.890167 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614384d8-6689-4548-be2c-885593e27238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:34.890838 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614384d8-6689-4548-be2c-885593e27238 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:34.891121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614384d8-6689-4548-be2c-885593e27238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:34.891400 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614384d8-6689-4548-be2c-885593e27238 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:34.892135 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614384d8-6689-4548-be2c-885593e27238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:34.894001 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614384d8-6689-4548-be2c-885593e27238 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:34.904312 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1382/2741] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:34.908591 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf116c-1cb0-4de4-bc2e-2eb5ad1b6443 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:34.919975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf116c-1cb0-4de4-bc2e-2eb5ad1b6443 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:34.924944 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e922bc-68d8-4f67-9a77-a4338faf66c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:34.925966 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e922bc-68d8-4f67-9a77-a4338faf66c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:34.926223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e922bc-68d8-4f67-9a77-a4338faf66c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:34.926495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e922bc-68d8-4f67-9a77-a4338faf66c5 admin admin] PATH_INFO: `/v3/projects/57fe5338d700481d89411d6fe6b5d6a0/users/9d76ceeda4764826ac3fb86c2781ac4c/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:34.941091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e922bc-68d8-4f67-9a77-a4338faf66c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57fe5338d700481d89411d6fe6b5d6a0, user_id=9d76ceeda4764826ac3fb86c2781ac4c, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:34.943739 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e922bc-68d8-4f67-9a77-a4338faf66c5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:34.956446 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1360/2742] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:34 2021] PUT /identity/v3/projects/57fe5338d700481d89411d6fe6b5d6a0/users/9d76ceeda4764826ac3fb86c2781ac4c/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:34.967142 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c276b0-7255-4abc-b669-1d33f4ea15ed None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:34.967634 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c276b0-7255-4abc-b669-1d33f4ea15ed None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:34.967732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c276b0-7255-4abc-b669-1d33f4ea15ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:34.995606 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-61c276b0-7255-4abc-b669-1d33f4ea15ed None None] MFA Rules not processed for user `9d76ceeda4764826ac3fb86c2781ac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:34.996833 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-61c276b0-7255-4abc-b669-1d33f4ea15ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:35.065184 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1383/2743] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:34 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:35.070592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e922bc-68d8-4f67-9a77-a4338faf66c5 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:35.138854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e922bc-68d8-4f67-9a77-a4338faf66c5 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:35.143638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f737af9-5d5c-445f-acf4-bb6b88a939b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:35.144294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737af9-5d5c-445f-acf4-bb6b88a939b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:35.144574 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737af9-5d5c-445f-acf4-bb6b88a939b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:35.144846 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737af9-5d5c-445f-acf4-bb6b88a939b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:35.145577 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f737af9-5d5c-445f-acf4-bb6b88a939b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:35.147579 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f737af9-5d5c-445f-acf4-bb6b88a939b9 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:35.186127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1361/2744] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:35 2021] POST /identity/v3/projects => generated 401 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:35.190434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c276b0-7255-4abc-b669-1d33f4ea15ed None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:35.204303 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c276b0-7255-4abc-b669-1d33f4ea15ed None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:35.271275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb30e-ac62-4904-84ff-3aa1afab44a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:35.272128 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb30e-ac62-4904-84ff-3aa1afab44a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:35.272403 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb30e-ac62-4904-84ff-3aa1afab44a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:35.272735 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb30e-ac62-4904-84ff-3aa1afab44a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:35.273628 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eb30e-ac62-4904-84ff-3aa1afab44a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:35.275731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eb30e-ac62-4904-84ff-3aa1afab44a1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:35.302978 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1384/2745] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:35 2021] POST /identity/v3/users => generated 307 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:35.304231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f737af9-5d5c-445f-acf4-bb6b88a939b9 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:35.315408 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f737af9-5d5c-445f-acf4-bb6b88a939b9 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:35.320985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad88a-0bd4-49a7-92c4-84461f963eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:35.321667 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad88a-0bd4-49a7-92c4-84461f963eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:35.322009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad88a-0bd4-49a7-92c4-84461f963eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:35.322231 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad88a-0bd4-49a7-92c4-84461f963eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:35.323154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ad88a-0bd4-49a7-92c4-84461f963eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:35.324768 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ad88a-0bd4-49a7-92c4-84461f963eb1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:35.337306 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1362/2746] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:35.341647 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb30e-ac62-4904-84ff-3aa1afab44a1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:35.354168 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb30e-ac62-4904-84ff-3aa1afab44a1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:35.360036 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aa002-bfa7-4c19-8dae-60aad07e920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:35.369388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa002-bfa7-4c19-8dae-60aad07e920c admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:35.369388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa002-bfa7-4c19-8dae-60aad07e920c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:35.369388 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa002-bfa7-4c19-8dae-60aad07e920c admin admin] PATH_INFO: `/v3/projects/679cd7117b55403fa6f51943c79ee037/users/24747012935e484b90be56595a04d5f9/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:35.382611 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141aa002-bfa7-4c19-8dae-60aad07e920c admin admin] RBAC: Authorizing `identity:create_grant(project_id=679cd7117b55403fa6f51943c79ee037, user_id=24747012935e484b90be56595a04d5f9, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:35.385797 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141aa002-bfa7-4c19-8dae-60aad07e920c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:35.402609 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1385/2747] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:35 2021] PUT /identity/v3/projects/679cd7117b55403fa6f51943c79ee037/users/24747012935e484b90be56595a04d5f9/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:35.406413 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad88a-0bd4-49a7-92c4-84461f963eb1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:35.417619 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad88a-0bd4-49a7-92c4-84461f963eb1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:35.482041 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eeb6e-69c3-4611-9bef-ca31abbd48f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:35.482715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eeb6e-69c3-4611-9bef-ca31abbd48f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:35.482995 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eeb6e-69c3-4611-9bef-ca31abbd48f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:35.483270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eeb6e-69c3-4611-9bef-ca31abbd48f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:35.484020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70eeb6e-69c3-4611-9bef-ca31abbd48f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:35.485611 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70eeb6e-69c3-4611-9bef-ca31abbd48f5 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:35.497513 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1363/2748] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:35 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:35.502106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aa002-bfa7-4c19-8dae-60aad07e920c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:35.512764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aa002-bfa7-4c19-8dae-60aad07e920c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:35.517853 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f00e15-5649-4bfa-8bdd-04655898c197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:35.518745 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00e15-5649-4bfa-8bdd-04655898c197 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:35.519022 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00e15-5649-4bfa-8bdd-04655898c197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:35.519298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00e15-5649-4bfa-8bdd-04655898c197 admin admin] PATH_INFO: `/v3/projects/679cd7117b55403fa6f51943c79ee037/users/24747012935e484b90be56595a04d5f9/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:35.521880 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f00e15-5649-4bfa-8bdd-04655898c197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679cd7117b55403fa6f51943c79ee037, user_id=24747012935e484b90be56595a04d5f9, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:35.524487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f00e15-5649-4bfa-8bdd-04655898c197 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:35.537035 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1386/2749] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:35 2021] PUT /identity/v3/projects/679cd7117b55403fa6f51943c79ee037/users/24747012935e484b90be56595a04d5f9/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:35.548104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8931ab6-65b3-42b5-bec5-9bcf2102cbd9 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:35.548389 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8931ab6-65b3-42b5-bec5-9bcf2102cbd9 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:35.548660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8931ab6-65b3-42b5-bec5-9bcf2102cbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:35.580621 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-a8931ab6-65b3-42b5-bec5-9bcf2102cbd9 None None] MFA Rules not processed for user `24747012935e484b90be56595a04d5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:35.582235 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-a8931ab6-65b3-42b5-bec5-9bcf2102cbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:35.656159 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1364/2750] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:35 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:35.666662 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f00e15-5649-4bfa-8bdd-04655898c197 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:35.668361 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-31f00e15-5649-4bfa-8bdd-04655898c197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:35.725130 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f00e15-5649-4bfa-8bdd-04655898c197 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:35.728926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f2fb-b76c-4782-983b-41a381aacba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:35.729564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f2fb-b76c-4782-983b-41a381aacba7 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:35.729877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f2fb-b76c-4782-983b-41a381aacba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:35.730154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f2fb-b76c-4782-983b-41a381aacba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:35.739057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f2fb-b76c-4782-983b-41a381aacba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:35.740467 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f2fb-b76c-4782-983b-41a381aacba7 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:35.749639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1387/2751] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:35 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:35.821450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8931ab6-65b3-42b5-bec5-9bcf2102cbd9 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:35.830928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8931ab6-65b3-42b5-bec5-9bcf2102cbd9 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:35.835353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e204f-59a9-423d-86b9-3c8007423f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:35.835999 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e204f-59a9-423d-86b9-3c8007423f99 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:35.836282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e204f-59a9-423d-86b9-3c8007423f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:35.836560 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e204f-59a9-423d-86b9-3c8007423f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:35.891795 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e204f-59a9-423d-86b9-3c8007423f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:35.893226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e204f-59a9-423d-86b9-3c8007423f99 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:35.903288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1365/2752] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:35 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:37.858909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f2fb-b76c-4782-983b-41a381aacba7 service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:37.860289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-16c6f2fb-b76c-4782-983b-41a381aacba7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:37.923244 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f2fb-b76c-4782-983b-41a381aacba7 service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:37.927789 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:37.928643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:37.928921 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:37.929195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] PATH_INFO: `/v3/users/52c98baee5a348039ee78b7c2fde84c6` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:37.930395 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c98baee5a348039ee78b7c2fde84c6)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:37.932295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:37.976630 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c98baee5a348039ee78b7c2fde84c6'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:37.983203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c98baee5a348039ee78b7c2fde84c6'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:37.983850 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c98baee5a348039ee78b7c2fde84c6'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:37.995232 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c98baee5a348039ee78b7c2fde84c6'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:37.995868 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c98baee5a348039ee78b7c2fde84c6'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:38.007881 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1388/2753] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:37 2021] DELETE /identity/v3/users/52c98baee5a348039ee78b7c2fde84c6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:38.012580 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d53ba0-75f9-410d-838a-391f9a81fb90 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:38.012975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d53ba0-75f9-410d-838a-391f9a81fb90 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:38.013245 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d53ba0-75f9-410d-838a-391f9a81fb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:38.031051 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d7d53ba0-75f9-410d-838a-391f9a81fb90 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:38.032565 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d7d53ba0-75f9-410d-838a-391f9a81fb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:38.088037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1366/2754] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:38.097840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:38.100047 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:38.155648 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56380ea3-5fad-40eb-9181-eb2a953f9085 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:38.159271 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfe411-4663-4a65-8bd1-cd0c36a7a6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:38.159905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfe411-4663-4a65-8bd1-cd0c36a7a6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:38.160180 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfe411-4663-4a65-8bd1-cd0c36a7a6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:38.160452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfe411-4663-4a65-8bd1-cd0c36a7a6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:38.169356 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acfe411-4663-4a65-8bd1-cd0c36a7a6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:38.170793 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acfe411-4663-4a65-8bd1-cd0c36a7a6f0 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:38.180014 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1389/2755] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:38.436426 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d53ba0-75f9-410d-838a-391f9a81fb90 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:38.437889 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d7d53ba0-75f9-410d-838a-391f9a81fb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:38.450897 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d53ba0-75f9-410d-838a-391f9a81fb90 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:38.455632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:38.456484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:38.456890 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:38.457015 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] PATH_INFO: `/v3/projects/80a6da0edd28443b931dd86bd7a5c3d0` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:38.458843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a6da0edd28443b931dd86bd7a5c3d0)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:38.461268 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:38.508415 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a6da0edd28443b931dd86bd7a5c3d0', 'request_id': 'req-9ef24242-ca10-4737-8485-5936591e6a5a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:38.514450 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a6da0edd28443b931dd86bd7a5c3d0', 'request_id': 'req-9ef24242-ca10-4737-8485-5936591e6a5a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:38.522352 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a6da0edd28443b931dd86bd7a5c3d0', 'request_id': 'req-9ef24242-ca10-4737-8485-5936591e6a5a'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:38.533928 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] The token cache is being invalidate because project 80a6da0edd28443b931dd86bd7a5c3d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:38.534219 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:38.534852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:38.536375 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1367/2756] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:38 2021] DELETE /identity/v3/projects/80a6da0edd28443b931dd86bd7a5c3d0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:38.540380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfe411-4663-4a65-8bd1-cd0c36a7a6f0 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:38.550459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfe411-4663-4a65-8bd1-cd0c36a7a6f0 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:38.613094 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:38.613933 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:38.614723 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:38.615005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] PATH_INFO: `/v3/users/0f356496de824d24bdd59a56e6fd6131` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:38.616982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f356496de824d24bdd59a56e6fd6131)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:38.619008 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:38.667805 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f356496de824d24bdd59a56e6fd6131'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:38.674509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f356496de824d24bdd59a56e6fd6131'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:38.675171 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f356496de824d24bdd59a56e6fd6131'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:38.687507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f356496de824d24bdd59a56e6fd6131'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:38.688175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f356496de824d24bdd59a56e6fd6131'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:38.701085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1390/2757] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:38 2021] DELETE /identity/v3/users/0f356496de824d24bdd59a56e6fd6131 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:38.974710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:38.976484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:38.989784 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef24242-ca10-4737-8485-5936591e6a5a admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:39.043852 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:39.044732 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:39.045008 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:39.045278 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] PATH_INFO: `/v3/projects/6ced9c22670b43a8b52c776b69dbe6d7` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:39.046465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ced9c22670b43a8b52c776b69dbe6d7)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:39.048346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:39.093012 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ced9c22670b43a8b52c776b69dbe6d7', 'request_id': 'req-129c40b1-23bd-49c6-be87-e904cf883425'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.099006 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ced9c22670b43a8b52c776b69dbe6d7', 'request_id': 'req-129c40b1-23bd-49c6-be87-e904cf883425'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.105873 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ced9c22670b43a8b52c776b69dbe6d7', 'request_id': 'req-129c40b1-23bd-49c6-be87-e904cf883425'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.115750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] The token cache is being invalidate because project 6ced9c22670b43a8b52c776b69dbe6d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:39.116033 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.116651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.118210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1368/2758] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:38 2021] DELETE /identity/v3/projects/6ced9c22670b43a8b52c776b69dbe6d7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:39.122274 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:39.123723 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:39.136799 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2effcb-e4b1-414c-b599-caa9a0a28fb6 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:39.191958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33398fe8-0eee-4e99-9c31-9a8195ebf31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:39.191958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398fe8-0eee-4e99-9c31-9a8195ebf31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:39.191958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398fe8-0eee-4e99-9c31-9a8195ebf31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:39.191958 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398fe8-0eee-4e99-9c31-9a8195ebf31f admin admin] PATH_INFO: `/v3/users/dc7818dec23b4d808b238834bf6a95d1` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:39.193700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33398fe8-0eee-4e99-9c31-9a8195ebf31f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7818dec23b4d808b238834bf6a95d1)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:39.195632 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33398fe8-0eee-4e99-9c31-9a8195ebf31f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:39.241015 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-33398fe8-0eee-4e99-9c31-9a8195ebf31f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7818dec23b4d808b238834bf6a95d1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.247774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-33398fe8-0eee-4e99-9c31-9a8195ebf31f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7818dec23b4d808b238834bf6a95d1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.248513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-33398fe8-0eee-4e99-9c31-9a8195ebf31f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7818dec23b4d808b238834bf6a95d1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.260904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-33398fe8-0eee-4e99-9c31-9a8195ebf31f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7818dec23b4d808b238834bf6a95d1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.261527 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-33398fe8-0eee-4e99-9c31-9a8195ebf31f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7818dec23b4d808b238834bf6a95d1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.273217 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1391/2759] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:39 2021] DELETE /identity/v3/users/dc7818dec23b4d808b238834bf6a95d1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:39.525987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:39.527492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:39.540370 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c40b1-23bd-49c6-be87-e904cf883425 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:39.596521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:39.597500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:39.597887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:39.598092 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] PATH_INFO: `/v3/projects/504cd965c0b54584a3ef82c0196f21c6` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:39.600194 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=504cd965c0b54584a3ef82c0196f21c6)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:39.602204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:39.647503 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504cd965c0b54584a3ef82c0196f21c6', 'request_id': 'req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.654726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504cd965c0b54584a3ef82c0196f21c6', 'request_id': 'req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.662632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504cd965c0b54584a3ef82c0196f21c6', 'request_id': 'req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.672506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] The token cache is being invalidate because project 504cd965c0b54584a3ef82c0196f21c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:39.672790 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.673412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-e21f8aa6-9f4c-44d5-a8b0-bacb20457e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:39.674984 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1369/2760] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:39 2021] DELETE /identity/v3/projects/504cd965c0b54584a3ef82c0196f21c6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:39.681452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657bd53-7e0b-44b0-9e48-18275d0c8587 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:39.681841 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657bd53-7e0b-44b0-9e48-18275d0c8587 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:39.682184 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657bd53-7e0b-44b0-9e48-18275d0c8587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:39.700325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-5657bd53-7e0b-44b0-9e48-18275d0c8587 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:39.701525 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-5657bd53-7e0b-44b0-9e48-18275d0c8587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:39.759623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1392/2761] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:39.769402 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740733fe-cb2e-4d98-a00a-a0fbfa6b3c58 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:39.769713 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740733fe-cb2e-4d98-a00a-a0fbfa6b3c58 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:39.770038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740733fe-cb2e-4d98-a00a-a0fbfa6b3c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:39.789900 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-740733fe-cb2e-4d98-a00a-a0fbfa6b3c58 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:39.791133 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-740733fe-cb2e-4d98-a00a-a0fbfa6b3c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:39.800034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1370/2762] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:39.804959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657bd53-7e0b-44b0-9e48-18275d0c8587 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:39.814912 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657bd53-7e0b-44b0-9e48-18275d0c8587 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:39.820538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dc9e3-ce59-4df1-b0c7-2f5ddda3e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:39.821437 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dc9e3-ce59-4df1-b0c7-2f5ddda3e94c admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:39.821906 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dc9e3-ce59-4df1-b0c7-2f5ddda3e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:39.822309 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dc9e3-ce59-4df1-b0c7-2f5ddda3e94c admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:39.826285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dc9e3-ce59-4df1-b0c7-2f5ddda3e94c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:45:39.826285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dc9e3-ce59-4df1-b0c7-2f5ddda3e94c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:39.826285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dc9e3-ce59-4df1-b0c7-2f5ddda3e94c admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:39.838090 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1393/2763] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:45:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:45:39.842176 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740733fe-cb2e-4d98-a00a-a0fbfa6b3c58 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:39.856677 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740733fe-cb2e-4d98-a00a-a0fbfa6b3c58 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:39.861329 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27497f-31d1-4f75-91bd-49c3a8141908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:39.862016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27497f-31d1-4f75-91bd-49c3a8141908 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:39.862299 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27497f-31d1-4f75-91bd-49c3a8141908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:39.862570 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27497f-31d1-4f75-91bd-49c3a8141908 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:39.863328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27497f-31d1-4f75-91bd-49c3a8141908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:39.865862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27497f-31d1-4f75-91bd-49c3a8141908 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:39.897722 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1371/2764] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:39 2021] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:39.900710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dc9e3-ce59-4df1-b0c7-2f5ddda3e94c admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:39.902045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27497f-31d1-4f75-91bd-49c3a8141908 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:39.902468 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-154dc9e3-ce59-4df1-b0c7-2f5ddda3e94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:39.915737 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dc9e3-ce59-4df1-b0c7-2f5ddda3e94c admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:39.962307 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27497f-31d1-4f75-91bd-49c3a8141908 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:39.967057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f1c91-925e-4d83-8f20-cd81d76a4a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:39.967721 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f1c91-925e-4d83-8f20-cd81d76a4a3e admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:39.968003 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f1c91-925e-4d83-8f20-cd81d76a4a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:39.968298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f1c91-925e-4d83-8f20-cd81d76a4a3e admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:39.969023 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f1c91-925e-4d83-8f20-cd81d76a4a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:39.969913 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15953320-f74d-4fe7-833e-f90760323a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:39.970781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15953320-f74d-4fe7-833e-f90760323a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:39.971085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15953320-f74d-4fe7-833e-f90760323a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:39.971181 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f1c91-925e-4d83-8f20-cd81d76a4a3e admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:39.971360 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15953320-f74d-4fe7-833e-f90760323a5e admin admin] PATH_INFO: `/v3/users/9d76ceeda4764826ac3fb86c2781ac4c` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:39.972578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15953320-f74d-4fe7-833e-f90760323a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d76ceeda4764826ac3fb86c2781ac4c)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:39.975288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15953320-f74d-4fe7-833e-f90760323a5e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:39.995637 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1372/2765] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:39 2021] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:39.996754 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f1c91-925e-4d83-8f20-cd81d76a4a3e admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:40.007270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f1c91-925e-4d83-8f20-cd81d76a4a3e admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:40.012238 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d22f8-e301-4176-837d-02c2a0be1422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:40.012905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d22f8-e301-4176-837d-02c2a0be1422 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:40.013186 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d22f8-e301-4176-837d-02c2a0be1422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:40.013461 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d22f8-e301-4176-837d-02c2a0be1422 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:40.014236 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d22f8-e301-4176-837d-02c2a0be1422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:40.016129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d22f8-e301-4176-837d-02c2a0be1422 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:40.021968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-15953320-f74d-4fe7-833e-f90760323a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d76ceeda4764826ac3fb86c2781ac4c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.026782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1373/2766] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:40.029926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-15953320-f74d-4fe7-833e-f90760323a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d76ceeda4764826ac3fb86c2781ac4c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.029926 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-15953320-f74d-4fe7-833e-f90760323a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d76ceeda4764826ac3fb86c2781ac4c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.031006 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d22f8-e301-4176-837d-02c2a0be1422 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:40.032790 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-3a2d22f8-e301-4176-837d-02c2a0be1422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:40.041967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-15953320-f74d-4fe7-833e-f90760323a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d76ceeda4764826ac3fb86c2781ac4c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.042653 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-15953320-f74d-4fe7-833e-f90760323a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d76ceeda4764826ac3fb86c2781ac4c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.044941 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d22f8-e301-4176-837d-02c2a0be1422 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:40.050319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c2deb-e86a-47dd-82f7-a222913ff70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:40.050975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c2deb-e86a-47dd-82f7-a222913ff70b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:40.051260 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c2deb-e86a-47dd-82f7-a222913ff70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:40.052056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c2deb-e86a-47dd-82f7-a222913ff70b admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:40.052815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c2deb-e86a-47dd-82f7-a222913ff70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:40.054507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c2deb-e86a-47dd-82f7-a222913ff70b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:40.055749 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1394/2767] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:39 2021] DELETE /identity/v3/users/9d76ceeda4764826ac3fb86c2781ac4c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:40.060318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd9eae-e6dd-4419-88a0-ff0f03010324 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:40.060318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd9eae-e6dd-4419-88a0-ff0f03010324 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:40.060554 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd9eae-e6dd-4419-88a0-ff0f03010324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:40.069005 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1374/2768] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:40 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:45:40.070652 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c2deb-e86a-47dd-82f7-a222913ff70b admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:40.079770 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-12bd9eae-e6dd-4419-88a0-ff0f03010324 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:40.080381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c2deb-e86a-47dd-82f7-a222913ff70b admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:40.080983 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-12bd9eae-e6dd-4419-88a0-ff0f03010324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:40.136120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa764df9-9fd5-4ee8-a4e2-4b790506eb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:40.137349 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764df9-9fd5-4ee8-a4e2-4b790506eb66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:40.137818 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764df9-9fd5-4ee8-a4e2-4b790506eb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:40.138282 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764df9-9fd5-4ee8-a4e2-4b790506eb66 admin admin] PATH_INFO: `/v3/projects/558b06e21f904c4a9453e568d181a57c/users/bfd00943afce4831971917b72228b4f7/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:40.139586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1395/2769] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:40.150171 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd9eae-e6dd-4419-88a0-ff0f03010324 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:40.151560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-12bd9eae-e6dd-4419-88a0-ff0f03010324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:40.155007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa764df9-9fd5-4ee8-a4e2-4b790506eb66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558b06e21f904c4a9453e568d181a57c, user_id=bfd00943afce4831971917b72228b4f7, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:40.157711 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa764df9-9fd5-4ee8-a4e2-4b790506eb66 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:40.171587 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1375/2770] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:40 2021] PUT /identity/v3/projects/558b06e21f904c4a9453e568d181a57c/users/bfd00943afce4831971917b72228b4f7/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:40.182270 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfac20-7bcb-44a1-ba13-cac6bce5233c None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:40.182549 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfac20-7bcb-44a1-ba13-cac6bce5233c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:40.182905 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfac20-7bcb-44a1-ba13-cac6bce5233c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:40.212077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd9eae-e6dd-4419-88a0-ff0f03010324 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:40.212802 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-1acfac20-7bcb-44a1-ba13-cac6bce5233c None None] MFA Rules not processed for user `bfd00943afce4831971917b72228b4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:40.214517 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1acfac20-7bcb-44a1-ba13-cac6bce5233c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:40.259545 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eddea-9ee7-49e7-8208-c52f52fc129a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:40.260095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eddea-9ee7-49e7-8208-c52f52fc129a service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:40.260373 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eddea-9ee7-49e7-8208-c52f52fc129a service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:40.260647 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eddea-9ee7-49e7-8208-c52f52fc129a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:40.279400 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1376/2771] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:40 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:40.291172 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfac20-7bcb-44a1-ba13-cac6bce5233c None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:40.292564 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-1acfac20-7bcb-44a1-ba13-cac6bce5233c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:40.322552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6eddea-9ee7-49e7-8208-c52f52fc129a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:40.323982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6eddea-9ee7-49e7-8208-c52f52fc129a service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:40.333350 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1396/2772] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:45:40.347045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfac20-7bcb-44a1-ba13-cac6bce5233c None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:40.351512 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec03f59-b7de-41fe-9a16-b173e676296b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ddafedf2734326832ab4bf620f7634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:40.352158 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec03f59-b7de-41fe-9a16-b173e676296b service glance] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:40.352437 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec03f59-b7de-41fe-9a16-b173e676296b service glance] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:40.352715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec03f59-b7de-41fe-9a16-b173e676296b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:40.361141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec03f59-b7de-41fe-9a16-b173e676296b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:40.362683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec03f59-b7de-41fe-9a16-b173e676296b service glance] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:40.371939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1377/2773] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:40 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:45:40.627766 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eddea-9ee7-49e7-8208-c52f52fc129a service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:40.629563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-8a6eddea-9ee7-49e7-8208-c52f52fc129a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:40.651867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eddea-9ee7-49e7-8208-c52f52fc129a service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:40.659516 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:40.660331 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:40.660607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:40.660894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] PATH_INFO: `/v3/projects/57fe5338d700481d89411d6fe6b5d6a0` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:40.662175 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=57fe5338d700481d89411d6fe6b5d6a0)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:40.664109 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:40.727925 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57fe5338d700481d89411d6fe6b5d6a0', 'request_id': 'req-310bcaef-beb0-4624-8b09-364f19d655ec'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.737425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57fe5338d700481d89411d6fe6b5d6a0', 'request_id': 'req-310bcaef-beb0-4624-8b09-364f19d655ec'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.746806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57fe5338d700481d89411d6fe6b5d6a0', 'request_id': 'req-310bcaef-beb0-4624-8b09-364f19d655ec'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.758242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] The token cache is being invalidate because project 57fe5338d700481d89411d6fe6b5d6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:40.758529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.759185 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.760734 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1397/2774] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:40 2021] DELETE /identity/v3/projects/57fe5338d700481d89411d6fe6b5d6a0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:40.764854 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec03f59-b7de-41fe-9a16-b173e676296b service glance] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:40.776180 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec03f59-b7de-41fe-9a16-b173e676296b service glance] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:40.852467 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def05ae6-b0c3-480a-b6f9-66c2d8e16f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:40.853414 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def05ae6-b0c3-480a-b6f9-66c2d8e16f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:40.853710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def05ae6-b0c3-480a-b6f9-66c2d8e16f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:40.854007 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def05ae6-b0c3-480a-b6f9-66c2d8e16f06 admin admin] PATH_INFO: `/v3/users/24747012935e484b90be56595a04d5f9` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:40.855275 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def05ae6-b0c3-480a-b6f9-66c2d8e16f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24747012935e484b90be56595a04d5f9)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:40.857233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def05ae6-b0c3-480a-b6f9-66c2d8e16f06 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:40.919660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-def05ae6-b0c3-480a-b6f9-66c2d8e16f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24747012935e484b90be56595a04d5f9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.927056 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-def05ae6-b0c3-480a-b6f9-66c2d8e16f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24747012935e484b90be56595a04d5f9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.935223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-def05ae6-b0c3-480a-b6f9-66c2d8e16f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24747012935e484b90be56595a04d5f9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.947338 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-def05ae6-b0c3-480a-b6f9-66c2d8e16f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24747012935e484b90be56595a04d5f9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.948038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-def05ae6-b0c3-480a-b6f9-66c2d8e16f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24747012935e484b90be56595a04d5f9'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:40.954126 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1378/2775] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:40 2021] DELETE /identity/v3/users/24747012935e484b90be56595a04d5f9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:41.281935 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:41.283867 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:41.298183 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bcaef-beb0-4624-8b09-364f19d655ec admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:41.364242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:41.365209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:41.365477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:41.365769 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] PATH_INFO: `/v3/projects/679cd7117b55403fa6f51943c79ee037` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:41.367409 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] RBAC: Authorizing `identity:delete_project(project_id=679cd7117b55403fa6f51943c79ee037)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:41.369325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:41.420941 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679cd7117b55403fa6f51943c79ee037', 'request_id': 'req-9bebcaad-5967-489e-a28c-6d6ceb0b066f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:41.428301 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679cd7117b55403fa6f51943c79ee037', 'request_id': 'req-9bebcaad-5967-489e-a28c-6d6ceb0b066f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:41.436479 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679cd7117b55403fa6f51943c79ee037', 'request_id': 'req-9bebcaad-5967-489e-a28c-6d6ceb0b066f'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:41.453639 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] The token cache is being invalidate because project 679cd7117b55403fa6f51943c79ee037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:41.453990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:41.454659 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-9bebcaad-5967-489e-a28c-6d6ceb0b066f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:41.456301 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1398/2776] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:41 2021] DELETE /identity/v3/projects/679cd7117b55403fa6f51943c79ee037 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:41.463744 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8897-0fdc-4adc-9735-8ac420008b64 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:41.464319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8897-0fdc-4adc-9735-8ac420008b64 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:41.464319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8897-0fdc-4adc-9735-8ac420008b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:41.486563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-99fe8897-0fdc-4adc-9735-8ac420008b64 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:41.487838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-99fe8897-0fdc-4adc-9735-8ac420008b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:41.550825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1379/2777] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:41.560873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638506c7-afa3-4137-a481-bd8361fb182b None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:41.561080 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638506c7-afa3-4137-a481-bd8361fb182b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:41.561445 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638506c7-afa3-4137-a481-bd8361fb182b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:41.587085 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-638506c7-afa3-4137-a481-bd8361fb182b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:41.587596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-638506c7-afa3-4137-a481-bd8361fb182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:41.597486 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1399/2778] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:41.602095 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe8897-0fdc-4adc-9735-8ac420008b64 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:41.611753 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe8897-0fdc-4adc-9735-8ac420008b64 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:41.617675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba5b84-c725-4d47-9938-60fd82384cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:41.618380 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba5b84-c725-4d47-9938-60fd82384cfa admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:41.618662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba5b84-c725-4d47-9938-60fd82384cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:41.618939 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba5b84-c725-4d47-9938-60fd82384cfa admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:41.619683 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba5b84-c725-4d47-9938-60fd82384cfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:45:41.619988 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba5b84-c725-4d47-9938-60fd82384cfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:41.621634 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba5b84-c725-4d47-9938-60fd82384cfa admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:41.644459 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1380/2779] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:45:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:45:41.648642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638506c7-afa3-4137-a481-bd8361fb182b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:41.658723 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638506c7-afa3-4137-a481-bd8361fb182b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:41.663794 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd7168-c04d-4ee6-9351-b308cbe4a99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:41.664483 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7168-c04d-4ee6-9351-b308cbe4a99b admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:41.664764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7168-c04d-4ee6-9351-b308cbe4a99b admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:41.665038 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7168-c04d-4ee6-9351-b308cbe4a99b admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:41.665831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd7168-c04d-4ee6-9351-b308cbe4a99b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:41.667736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd7168-c04d-4ee6-9351-b308cbe4a99b admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:41.697779 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1400/2780] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:41 2021] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:41.702895 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba5b84-c725-4d47-9938-60fd82384cfa admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:41.717651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba5b84-c725-4d47-9938-60fd82384cfa admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:41.777211 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc26476-0f65-4d81-943e-b6350e1e7078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:41.777922 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc26476-0f65-4d81-943e-b6350e1e7078 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:41.778197 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc26476-0f65-4d81-943e-b6350e1e7078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:41.778623 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc26476-0f65-4d81-943e-b6350e1e7078 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:41.779272 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc26476-0f65-4d81-943e-b6350e1e7078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:41.781115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc26476-0f65-4d81-943e-b6350e1e7078 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:41.804348 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1381/2781] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:41 2021] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:41.809700 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd7168-c04d-4ee6-9351-b308cbe4a99b admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:41.825099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd7168-c04d-4ee6-9351-b308cbe4a99b admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:41.829829 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9ae6d-4f49-4355-b1d0-aea42c6ee8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:41.830542 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9ae6d-4f49-4355-b1d0-aea42c6ee8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:41.830827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9ae6d-4f49-4355-b1d0-aea42c6ee8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:41.831109 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9ae6d-4f49-4355-b1d0-aea42c6ee8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:41.831876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9ae6d-4f49-4355-b1d0-aea42c6ee8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:41.833564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9ae6d-4f49-4355-b1d0-aea42c6ee8f3 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:41.850874 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1401/2782] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:41 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:41.855829 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc26476-0f65-4d81-943e-b6350e1e7078 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:41.867048 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc26476-0f65-4d81-943e-b6350e1e7078 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:41.871887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69df5a-b2f5-4370-b776-63e3e1ef5b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:41.872555 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69df5a-b2f5-4370-b776-63e3e1ef5b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:41.872832 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69df5a-b2f5-4370-b776-63e3e1ef5b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:41.873102 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69df5a-b2f5-4370-b776-63e3e1ef5b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:41.873866 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69df5a-b2f5-4370-b776-63e3e1ef5b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:41.875445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69df5a-b2f5-4370-b776-63e3e1ef5b3b admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:41.890665 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1382/2783] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:41 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:41.897009 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9ae6d-4f49-4355-b1d0-aea42c6ee8f3 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:41.915049 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9ae6d-4f49-4355-b1d0-aea42c6ee8f3 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:41.922210 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ba604-4ff4-4200-bac2-7c68f7b47372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:41.923282 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ba604-4ff4-4200-bac2-7c68f7b47372 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:41.923563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ba604-4ff4-4200-bac2-7c68f7b47372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:41.923835 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ba604-4ff4-4200-bac2-7c68f7b47372 admin admin] PATH_INFO: `/v3/projects/645d249ee6864ab587d3993f6fa23b61/users/bb8eb738a3d94ef3b0ffec5e70f47138/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:41.943816 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ba604-4ff4-4200-bac2-7c68f7b47372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645d249ee6864ab587d3993f6fa23b61, user_id=bb8eb738a3d94ef3b0ffec5e70f47138, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:41.946456 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ba604-4ff4-4200-bac2-7c68f7b47372 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:41.964936 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1402/2784] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:41 2021] PUT /identity/v3/projects/645d249ee6864ab587d3993f6fa23b61/users/bb8eb738a3d94ef3b0ffec5e70f47138/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:41.976453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717283-75e5-41fe-a494-e3f3a9e0122c None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:41.976735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717283-75e5-41fe-a494-e3f3a9e0122c None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:41.977025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717283-75e5-41fe-a494-e3f3a9e0122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:42.012151 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-54717283-75e5-41fe-a494-e3f3a9e0122c None None] MFA Rules not processed for user `bb8eb738a3d94ef3b0ffec5e70f47138`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:42.013376 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-54717283-75e5-41fe-a494-e3f3a9e0122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:42.080953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1383/2785] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:41 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:42.085420 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ba604-4ff4-4200-bac2-7c68f7b47372 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:42.150786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ba604-4ff4-4200-bac2-7c68f7b47372 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:42.155811 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f72bf6-a050-4878-9c38-fcea0c879148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:42.156475 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72bf6-a050-4878-9c38-fcea0c879148 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:42.156762 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72bf6-a050-4878-9c38-fcea0c879148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:42.157042 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72bf6-a050-4878-9c38-fcea0c879148 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:42.157772 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f72bf6-a050-4878-9c38-fcea0c879148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:42.159745 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f72bf6-a050-4878-9c38-fcea0c879148 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:42.186906 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1403/2786] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:42 2021] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:42.191229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717283-75e5-41fe-a494-e3f3a9e0122c None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:42.201955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717283-75e5-41fe-a494-e3f3a9e0122c None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:42.259419 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbeb41-91d7-4ee6-b921-d954a2521976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:42.260097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbeb41-91d7-4ee6-b921-d954a2521976 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:42.260381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbeb41-91d7-4ee6-b921-d954a2521976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:42.260656 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbeb41-91d7-4ee6-b921-d954a2521976 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:42.261487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbeb41-91d7-4ee6-b921-d954a2521976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:42.263442 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbeb41-91d7-4ee6-b921-d954a2521976 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:42.283909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1384/2787] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:42 2021] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:42.288547 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f72bf6-a050-4878-9c38-fcea0c879148 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:42.299465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f72bf6-a050-4878-9c38-fcea0c879148 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:42.304467 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbea52-f6b9-43b0-a9eb-eab1725ec08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:42.305132 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbea52-f6b9-43b0-a9eb-eab1725ec08e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:42.305423 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbea52-f6b9-43b0-a9eb-eab1725ec08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:42.305730 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbea52-f6b9-43b0-a9eb-eab1725ec08e admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:42.306756 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbea52-f6b9-43b0-a9eb-eab1725ec08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:42.308424 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbea52-f6b9-43b0-a9eb-eab1725ec08e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:42.320235 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1404/2788] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:42 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:42.324418 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbeb41-91d7-4ee6-b921-d954a2521976 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:42.335009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbeb41-91d7-4ee6-b921-d954a2521976 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:42.339569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed7f04-4d7f-4ae4-8eae-5dffa85fff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:42.340461 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7f04-4d7f-4ae4-8eae-5dffa85fff15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:42.340736 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7f04-4d7f-4ae4-8eae-5dffa85fff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:42.341013 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7f04-4d7f-4ae4-8eae-5dffa85fff15 admin admin] PATH_INFO: `/v3/projects/2d729194753d4882ad3a5cd8b4b9fde8/users/22b8bd9137e04639b9693f09c06e647d/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:42.357459 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed7f04-4d7f-4ae4-8eae-5dffa85fff15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d729194753d4882ad3a5cd8b4b9fde8, user_id=22b8bd9137e04639b9693f09c06e647d, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:42.360113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed7f04-4d7f-4ae4-8eae-5dffa85fff15 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:42.372847 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1385/2789] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:42 2021] PUT /identity/v3/projects/2d729194753d4882ad3a5cd8b4b9fde8/users/22b8bd9137e04639b9693f09c06e647d/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:42.376624 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbea52-f6b9-43b0-a9eb-eab1725ec08e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:42.388067 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbea52-f6b9-43b0-a9eb-eab1725ec08e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:42.445358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac9b4d-25b8-42d8-b275-e18f051c4963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:42.446077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac9b4d-25b8-42d8-b275-e18f051c4963 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:42.446357 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac9b4d-25b8-42d8-b275-e18f051c4963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:42.446633 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac9b4d-25b8-42d8-b275-e18f051c4963 admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:42.447365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac9b4d-25b8-42d8-b275-e18f051c4963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:42.448962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac9b4d-25b8-42d8-b275-e18f051c4963 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:42.459590 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1405/2790] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:42 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:42.463914 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed7f04-4d7f-4ae4-8eae-5dffa85fff15 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:42.474750 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed7f04-4d7f-4ae4-8eae-5dffa85fff15 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:42.480321 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399a901-0d6f-42e3-9327-125cccacefde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:42.481369 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399a901-0d6f-42e3-9327-125cccacefde admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:42.481651 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399a901-0d6f-42e3-9327-125cccacefde admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:42.481948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399a901-0d6f-42e3-9327-125cccacefde admin admin] PATH_INFO: `/v3/projects/2d729194753d4882ad3a5cd8b4b9fde8/users/22b8bd9137e04639b9693f09c06e647d/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:42.484004 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399a901-0d6f-42e3-9327-125cccacefde admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d729194753d4882ad3a5cd8b4b9fde8, user_id=22b8bd9137e04639b9693f09c06e647d, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:42.486640 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399a901-0d6f-42e3-9327-125cccacefde admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:42.497051 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1386/2791] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:42 2021] PUT /identity/v3/projects/2d729194753d4882ad3a5cd8b4b9fde8/users/22b8bd9137e04639b9693f09c06e647d/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:42.508222 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec8cf9-4e43-4bb8-863a-cdf68c638c3d None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:42.508511 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec8cf9-4e43-4bb8-863a-cdf68c638c3d None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:42.508787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec8cf9-4e43-4bb8-863a-cdf68c638c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:42.535784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-ecec8cf9-4e43-4bb8-863a-cdf68c638c3d None None] MFA Rules not processed for user `22b8bd9137e04639b9693f09c06e647d`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:42.537580 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ecec8cf9-4e43-4bb8-863a-cdf68c638c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:42.607728 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1406/2792] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:42 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:42.617475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399a901-0d6f-42e3-9327-125cccacefde admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:42.619218 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-5399a901-0d6f-42e3-9327-125cccacefde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:42.677085 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399a901-0d6f-42e3-9327-125cccacefde admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:42.681132 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa636cc-bf6d-44af-962a-84ece20a1cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:42.682046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa636cc-bf6d-44af-962a-84ece20a1cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:42.682409 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa636cc-bf6d-44af-962a-84ece20a1cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:42.682692 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa636cc-bf6d-44af-962a-84ece20a1cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:42.693745 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa636cc-bf6d-44af-962a-84ece20a1cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:42.695286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa636cc-bf6d-44af-962a-84ece20a1cc6 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:42.704675 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1387/2793] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:42 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:42.826601 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec8cf9-4e43-4bb8-863a-cdf68c638c3d None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:42.887887 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec8cf9-4e43-4bb8-863a-cdf68c638c3d None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:42.892408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:42.893278 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:42.893558 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:42.893868 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] PATH_INFO: `/v3/users/bb8eb738a3d94ef3b0ffec5e70f47138` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:42.895140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8eb738a3d94ef3b0ffec5e70f47138)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:42.897677 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:42.944457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8eb738a3d94ef3b0ffec5e70f47138'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:42.951103 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8eb738a3d94ef3b0ffec5e70f47138'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:42.951762 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8eb738a3d94ef3b0ffec5e70f47138'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:42.963457 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8eb738a3d94ef3b0ffec5e70f47138'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:42.964140 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8eb738a3d94ef3b0ffec5e70f47138'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:42.978774 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1407/2794] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:42 2021] DELETE /identity/v3/users/bb8eb738a3d94ef3b0ffec5e70f47138 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:42.983256 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff244cd-3bb6-4cc4-ac7c-27c27cb11dea None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:42.983755 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff244cd-3bb6-4cc4-ac7c-27c27cb11dea None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:42.983876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff244cd-3bb6-4cc4-ac7c-27c27cb11dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:43.002234 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-2ff244cd-3bb6-4cc4-ac7c-27c27cb11dea None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:43.003822 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2ff244cd-3bb6-4cc4-ac7c-27c27cb11dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:43.064470 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1388/2795] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:43.074464 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:43.075878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:43.134131 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871624d8-3fae-4789-ba62-fea469956a56 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:43.137827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475388c-ee87-435a-b909-4e7b00a47a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:43.138531 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475388c-ee87-435a-b909-4e7b00a47a2f service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:43.138757 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475388c-ee87-435a-b909-4e7b00a47a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:43.139029 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475388c-ee87-435a-b909-4e7b00a47a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:43.148818 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475388c-ee87-435a-b909-4e7b00a47a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:43.150267 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475388c-ee87-435a-b909-4e7b00a47a2f service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:43.159390 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1408/2796] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:43.434957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff244cd-3bb6-4cc4-ac7c-27c27cb11dea None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:43.436502 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-2ff244cd-3bb6-4cc4-ac7c-27c27cb11dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:43.448826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff244cd-3bb6-4cc4-ac7c-27c27cb11dea None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:43.453710 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:43.454667 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:43.455025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:43.455373 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] PATH_INFO: `/v3/projects/645d249ee6864ab587d3993f6fa23b61` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:43.456669 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=645d249ee6864ab587d3993f6fa23b61)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:43.458732 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:43.505398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645d249ee6864ab587d3993f6fa23b61', 'request_id': 'req-78a2abb9-76af-45f5-a4fa-451c4d644665'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:43.511575 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645d249ee6864ab587d3993f6fa23b61', 'request_id': 'req-78a2abb9-76af-45f5-a4fa-451c4d644665'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:43.519825 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645d249ee6864ab587d3993f6fa23b61', 'request_id': 'req-78a2abb9-76af-45f5-a4fa-451c4d644665'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:43.529862 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] The token cache is being invalidate because project 645d249ee6864ab587d3993f6fa23b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:43.530237 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:43.530951 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:43.532760 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1389/2797] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:43 2021] DELETE /identity/v3/projects/645d249ee6864ab587d3993f6fa23b61 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:43.537401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475388c-ee87-435a-b909-4e7b00a47a2f service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:43.547154 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475388c-ee87-435a-b909-4e7b00a47a2f service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:43.604410 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124759f-7c8e-442e-bb24-f0edbb05a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:43.605272 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124759f-7c8e-442e-bb24-f0edbb05a56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:43.605552 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124759f-7c8e-442e-bb24-f0edbb05a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:43.605877 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124759f-7c8e-442e-bb24-f0edbb05a56f admin admin] PATH_INFO: `/v3/users/22b8bd9137e04639b9693f09c06e647d` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:43.607084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124759f-7c8e-442e-bb24-f0edbb05a56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b8bd9137e04639b9693f09c06e647d)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:43.609000 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124759f-7c8e-442e-bb24-f0edbb05a56f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:43.655876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d124759f-7c8e-442e-bb24-f0edbb05a56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b8bd9137e04639b9693f09c06e647d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:43.663413 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d124759f-7c8e-442e-bb24-f0edbb05a56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b8bd9137e04639b9693f09c06e647d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:43.664080 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d124759f-7c8e-442e-bb24-f0edbb05a56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b8bd9137e04639b9693f09c06e647d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:43.675524 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d124759f-7c8e-442e-bb24-f0edbb05a56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b8bd9137e04639b9693f09c06e647d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:43.676164 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d124759f-7c8e-442e-bb24-f0edbb05a56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b8bd9137e04639b9693f09c06e647d'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:43.689950 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1409/2798] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:43 2021] DELETE /identity/v3/users/22b8bd9137e04639b9693f09c06e647d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:43.954053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:43.955488 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:43.973057 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2abb9-76af-45f5-a4fa-451c4d644665 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:44.038201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:44.038977 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.039254 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.039527 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] PATH_INFO: `/v3/projects/2d729194753d4882ad3a5cd8b4b9fde8` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.040834 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d729194753d4882ad3a5cd8b4b9fde8)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:44.042919 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:44.089571 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d729194753d4882ad3a5cd8b4b9fde8', 'request_id': 'req-9efd764a-ae5f-4050-85fe-7c127440238d'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:44.095547 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d729194753d4882ad3a5cd8b4b9fde8', 'request_id': 'req-9efd764a-ae5f-4050-85fe-7c127440238d'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:44.103782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d729194753d4882ad3a5cd8b4b9fde8', 'request_id': 'req-9efd764a-ae5f-4050-85fe-7c127440238d'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:44.114618 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] The token cache is being invalidate because project 2d729194753d4882ad3a5cd8b4b9fde8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:44.114902 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:44.115548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-9efd764a-ae5f-4050-85fe-7c127440238d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:44.117286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1390/2799] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:43 2021] DELETE /identity/v3/projects/2d729194753d4882ad3a5cd8b4b9fde8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:44.122826 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9709-edc0-4c1e-8e20-d444ef513e04 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.123119 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9709-edc0-4c1e-8e20-d444ef513e04 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.123406 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9709-edc0-4c1e-8e20-d444ef513e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.142732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-670d9709-edc0-4c1e-8e20-d444ef513e04 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:44.144012 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-670d9709-edc0-4c1e-8e20-d444ef513e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:44.204229 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1410/2800] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:44.213605 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dffb87-b5ee-4ea3-b0f3-de8ccaab4796 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.213927 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dffb87-b5ee-4ea3-b0f3-de8ccaab4796 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.214209 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dffb87-b5ee-4ea3-b0f3-de8ccaab4796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.235955 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c6dffb87-b5ee-4ea3-b0f3-de8ccaab4796 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:44.237720 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c6dffb87-b5ee-4ea3-b0f3-de8ccaab4796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:44.248113 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1391/2801] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:44.252808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d9709-edc0-4c1e-8e20-d444ef513e04 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:44.264844 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d9709-edc0-4c1e-8e20-d444ef513e04 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:44.271288 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d223c-9bbc-4cc7-8700-00e38d7e8d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:44.271965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d223c-9bbc-4cc7-8700-00e38d7e8d40 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.272450 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d223c-9bbc-4cc7-8700-00e38d7e8d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.272798 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d223c-9bbc-4cc7-8700-00e38d7e8d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.273680 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d223c-9bbc-4cc7-8700-00e38d7e8d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:45:44.274057 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d223c-9bbc-4cc7-8700-00e38d7e8d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:44.275666 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d223c-9bbc-4cc7-8700-00e38d7e8d40 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:44.287570 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1411/2802] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:45:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:45:44.291965 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dffb87-b5ee-4ea3-b0f3-de8ccaab4796 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:44.301023 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dffb87-b5ee-4ea3-b0f3-de8ccaab4796 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:44.305616 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17d780-b543-4134-9e1c-a6cfd1077b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:44.306285 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d780-b543-4134-9e1c-a6cfd1077b7f admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.306562 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d780-b543-4134-9e1c-a6cfd1077b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.306860 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d780-b543-4134-9e1c-a6cfd1077b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.307585 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17d780-b543-4134-9e1c-a6cfd1077b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:44.309593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17d780-b543-4134-9e1c-a6cfd1077b7f admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:44.335991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1392/2803] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:44 2021] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:44.340262 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d223c-9bbc-4cc7-8700-00e38d7e8d40 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:44.351663 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d223c-9bbc-4cc7-8700-00e38d7e8d40 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:44.408257 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dfb42-f58a-4cb3-bc56-27e2bbad2646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:44.408923 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dfb42-f58a-4cb3-bc56-27e2bbad2646 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.409203 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dfb42-f58a-4cb3-bc56-27e2bbad2646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.409474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dfb42-f58a-4cb3-bc56-27e2bbad2646 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.410216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5dfb42-f58a-4cb3-bc56-27e2bbad2646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:44.412147 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5dfb42-f58a-4cb3-bc56-27e2bbad2646 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:44.431937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1412/2804] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:44 2021] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:44.436192 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17d780-b543-4134-9e1c-a6cfd1077b7f admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:44.447395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17d780-b543-4134-9e1c-a6cfd1077b7f admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:44.452063 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0395d97-495b-44cf-9252-fbd2644017e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:44.452741 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395d97-495b-44cf-9252-fbd2644017e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.453025 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395d97-495b-44cf-9252-fbd2644017e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.453321 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395d97-495b-44cf-9252-fbd2644017e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.454148 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0395d97-495b-44cf-9252-fbd2644017e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:44.455848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0395d97-495b-44cf-9252-fbd2644017e0 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:44.467298 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1393/2805] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:44.471260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dfb42-f58a-4cb3-bc56-27e2bbad2646 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:44.481260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dfb42-f58a-4cb3-bc56-27e2bbad2646 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:44.485827 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d01bcc-ba37-4c7b-a788-c456d5377e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:44.486474 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d01bcc-ba37-4c7b-a788-c456d5377e6a admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.486752 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d01bcc-ba37-4c7b-a788-c456d5377e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.487022 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d01bcc-ba37-4c7b-a788-c456d5377e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.487776 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d01bcc-ba37-4c7b-a788-c456d5377e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:44.489876 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d01bcc-ba37-4c7b-a788-c456d5377e6a admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:44.499408 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1413/2806] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:44.503632 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0395d97-495b-44cf-9252-fbd2644017e0 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:44.514506 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0395d97-495b-44cf-9252-fbd2644017e0 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:44.519660 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d74c6-2573-449f-a7b5-98a072bb6c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:44.520451 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d74c6-2573-449f-a7b5-98a072bb6c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.520726 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d74c6-2573-449f-a7b5-98a072bb6c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.520991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d74c6-2573-449f-a7b5-98a072bb6c9d admin admin] PATH_INFO: `/v3/projects/ad75c90355234530bfc7a16598a46bd5/users/9c72f8be1a7446889f7fc7919923e96b/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.535230 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d74c6-2573-449f-a7b5-98a072bb6c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad75c90355234530bfc7a16598a46bd5, user_id=9c72f8be1a7446889f7fc7919923e96b, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:44.538884 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d74c6-2573-449f-a7b5-98a072bb6c9d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:44.557005 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1394/2807] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:44 2021] PUT /identity/v3/projects/ad75c90355234530bfc7a16598a46bd5/users/9c72f8be1a7446889f7fc7919923e96b/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:44.568380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c60fb-1ca2-4d6a-8dea-9302bf65f4e6 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.568998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c60fb-1ca2-4d6a-8dea-9302bf65f4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.568998 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c60fb-1ca2-4d6a-8dea-9302bf65f4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.597365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-294c60fb-1ca2-4d6a-8dea-9302bf65f4e6 None None] MFA Rules not processed for user `9c72f8be1a7446889f7fc7919923e96b`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:44.598643 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-294c60fb-1ca2-4d6a-8dea-9302bf65f4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:44.665795 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1414/2808] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:44 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:44.670485 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d74c6-2573-449f-a7b5-98a072bb6c9d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:44.732849 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d74c6-2573-449f-a7b5-98a072bb6c9d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:44.737344 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177de69-eac7-4ff8-8648-23e09ad9cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:44.738037 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177de69-eac7-4ff8-8648-23e09ad9cc15 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.738318 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177de69-eac7-4ff8-8648-23e09ad9cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.738592 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177de69-eac7-4ff8-8648-23e09ad9cc15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.739834 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177de69-eac7-4ff8-8648-23e09ad9cc15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:44.741723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177de69-eac7-4ff8-8648-23e09ad9cc15 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:44.766986 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1395/2809] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:44 2021] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:45:44.771002 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c60fb-1ca2-4d6a-8dea-9302bf65f4e6 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:44.781670 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c60fb-1ca2-4d6a-8dea-9302bf65f4e6 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:44.837781 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115b6f5-d753-45b0-a07d-281780c43235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:44.838516 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b6f5-d753-45b0-a07d-281780c43235 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.838809 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b6f5-d753-45b0-a07d-281780c43235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.839109 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b6f5-d753-45b0-a07d-281780c43235 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.839839 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115b6f5-d753-45b0-a07d-281780c43235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:44.841763 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115b6f5-d753-45b0-a07d-281780c43235 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:44.862988 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1415/2810] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:44 2021] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:44.867690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177de69-eac7-4ff8-8648-23e09ad9cc15 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:44.879953 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177de69-eac7-4ff8-8648-23e09ad9cc15 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:44.884845 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f0f63-84db-47d4-9c9f-0b03729a1571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:44.885785 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0f63-84db-47d4-9c9f-0b03729a1571 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.886078 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0f63-84db-47d4-9c9f-0b03729a1571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.886356 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0f63-84db-47d4-9c9f-0b03729a1571 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.887091 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f0f63-84db-47d4-9c9f-0b03729a1571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:44.888696 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f0f63-84db-47d4-9c9f-0b03729a1571 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:44.899985 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1396/2811] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:44 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:44.904026 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115b6f5-d753-45b0-a07d-281780c43235 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:44.915136 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115b6f5-d753-45b0-a07d-281780c43235 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:44.919899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf40cbd-c774-43d9-8dfa-f63d14c34615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:44.920968 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40cbd-c774-43d9-8dfa-f63d14c34615 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:44.921246 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40cbd-c774-43d9-8dfa-f63d14c34615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:44.921523 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40cbd-c774-43d9-8dfa-f63d14c34615 admin admin] PATH_INFO: `/v3/projects/4b8df23fe54346199222262cc0357a79/users/8045238c00764d15b628c7a35763bf00/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:44.937615 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf40cbd-c774-43d9-8dfa-f63d14c34615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8df23fe54346199222262cc0357a79, user_id=8045238c00764d15b628c7a35763bf00, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:44.940256 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf40cbd-c774-43d9-8dfa-f63d14c34615 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:44.954266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1416/2812] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:44 2021] PUT /identity/v3/projects/4b8df23fe54346199222262cc0357a79/users/8045238c00764d15b628c7a35763bf00/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:44.958492 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f0f63-84db-47d4-9c9f-0b03729a1571 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:44.968324 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f0f63-84db-47d4-9c9f-0b03729a1571 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:45.025647 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1887a09-13a7-4d43-a3c6-bc89533199da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:45.026250 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1887a09-13a7-4d43-a3c6-bc89533199da admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:45.026531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1887a09-13a7-4d43-a3c6-bc89533199da admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:45.026804 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1887a09-13a7-4d43-a3c6-bc89533199da admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:45.027529 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1887a09-13a7-4d43-a3c6-bc89533199da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:45.029108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1887a09-13a7-4d43-a3c6-bc89533199da admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:45.039705 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1397/2813] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:44 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:45.043887 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf40cbd-c774-43d9-8dfa-f63d14c34615 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:45.054638 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf40cbd-c774-43d9-8dfa-f63d14c34615 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:45.059362 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdd721-f897-41ba-b1e8-692205621e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:45.060260 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdd721-f897-41ba-b1e8-692205621e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:45.060570 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdd721-f897-41ba-b1e8-692205621e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:45.060841 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdd721-f897-41ba-b1e8-692205621e30 admin admin] PATH_INFO: `/v3/projects/4b8df23fe54346199222262cc0357a79/users/8045238c00764d15b628c7a35763bf00/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:45.062880 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdd721-f897-41ba-b1e8-692205621e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8df23fe54346199222262cc0357a79, user_id=8045238c00764d15b628c7a35763bf00, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:45.065499 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdd721-f897-41ba-b1e8-692205621e30 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:45.076993 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1417/2814] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:45 2021] PUT /identity/v3/projects/4b8df23fe54346199222262cc0357a79/users/8045238c00764d15b628c7a35763bf00/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:45.088917 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b8ae4-40c2-4f51-8d6b-5f17edd6a44a None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:45.089202 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b8ae4-40c2-4f51-8d6b-5f17edd6a44a None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:45.089512 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b8ae4-40c2-4f51-8d6b-5f17edd6a44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:45.118029 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d11b8ae4-40c2-4f51-8d6b-5f17edd6a44a None None] MFA Rules not processed for user `8045238c00764d15b628c7a35763bf00`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:45.119247 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d11b8ae4-40c2-4f51-8d6b-5f17edd6a44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:45.193521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1398/2815] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:45 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:45.204105 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdd721-f897-41ba-b1e8-692205621e30 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:45.205891 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-e2bdd721-f897-41ba-b1e8-692205621e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:45.268298 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdd721-f897-41ba-b1e8-692205621e30 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:45.272642 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9df43d-9c49-4de0-b951-dc35c21b3aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:45.273294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df43d-9c49-4de0-b951-dc35c21b3aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:45.273574 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df43d-9c49-4de0-b951-dc35c21b3aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:45.273880 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df43d-9c49-4de0-b951-dc35c21b3aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:45.283615 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9df43d-9c49-4de0-b951-dc35c21b3aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:45.285558 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9df43d-9c49-4de0-b951-dc35c21b3aa7 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:45.297082 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1418/2816] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:45 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:45.372775 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b8ae4-40c2-4f51-8d6b-5f17edd6a44a None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:45.384996 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b8ae4-40c2-4f51-8d6b-5f17edd6a44a None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:45.388974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85817a7f-8ab9-4bd9-b03f-42ba6578c8a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:45.389627 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85817a7f-8ab9-4bd9-b03f-42ba6578c8a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:45.389943 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85817a7f-8ab9-4bd9-b03f-42ba6578c8a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:45.390226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85817a7f-8ab9-4bd9-b03f-42ba6578c8a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:45.452991 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85817a7f-8ab9-4bd9-b03f-42ba6578c8a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:45.454507 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85817a7f-8ab9-4bd9-b03f-42ba6578c8a0 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:45.467848 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1399/2817] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:45 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:45.768978 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9df43d-9c49-4de0-b951-dc35c21b3aa7 service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:45.843538 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9df43d-9c49-4de0-b951-dc35c21b3aa7 service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:45.852512 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:45.853831 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:45.854037 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:45.854402 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] PATH_INFO: `/v3/users/9c72f8be1a7446889f7fc7919923e96b` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:45.855640 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c72f8be1a7446889f7fc7919923e96b)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:45.857795 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:45.926899 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c72f8be1a7446889f7fc7919923e96b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:45.940214 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c72f8be1a7446889f7fc7919923e96b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:45.943529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c72f8be1a7446889f7fc7919923e96b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:45.962308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c72f8be1a7446889f7fc7919923e96b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:45.963095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c72f8be1a7446889f7fc7919923e96b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:45.980586 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1419/2818] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:45 2021] DELETE /identity/v3/users/9c72f8be1a7446889f7fc7919923e96b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:45.985381 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffe682-de87-49ca-ab1e-f13fd7a826d6 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:45.986105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffe682-de87-49ca-ab1e-f13fd7a826d6 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:45.986105 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffe682-de87-49ca-ab1e-f13fd7a826d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:46.008002 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-d7ffe682-de87-49ca-ab1e-f13fd7a826d6 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:46.009224 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d7ffe682-de87-49ca-ab1e-f13fd7a826d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:46.082539 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1400/2819] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:45:46.093382 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:46.094948 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:46.179240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f79fd-89c1-43f3-bcbb-8266420dec94 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:46.184266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683ce91-bd4a-4bd0-8cf8-deae9f99fc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:46.185581 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683ce91-bd4a-4bd0-8cf8-deae9f99fc82 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:46.186215 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683ce91-bd4a-4bd0-8cf8-deae9f99fc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:46.186613 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683ce91-bd4a-4bd0-8cf8-deae9f99fc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:46.205106 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683ce91-bd4a-4bd0-8cf8-deae9f99fc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:46.208368 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683ce91-bd4a-4bd0-8cf8-deae9f99fc82 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:46.224477 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1420/2820] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:46.566844 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffe682-de87-49ca-ab1e-f13fd7a826d6 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:46.571475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d7ffe682-de87-49ca-ab1e-f13fd7a826d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:46.591974 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffe682-de87-49ca-ab1e-f13fd7a826d6 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:46.604467 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:46.605832 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:46.606327 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:46.606824 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] PATH_INFO: `/v3/projects/ad75c90355234530bfc7a16598a46bd5` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:46.608676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad75c90355234530bfc7a16598a46bd5)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:46.611223 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:46.716663 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad75c90355234530bfc7a16598a46bd5', 'request_id': 'req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:46.726645 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad75c90355234530bfc7a16598a46bd5', 'request_id': 'req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:46.739191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad75c90355234530bfc7a16598a46bd5', 'request_id': 'req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:46.756767 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] The token cache is being invalidate because project ad75c90355234530bfc7a16598a46bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:46.757144 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:46.757877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:46.762089 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1401/2821] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:46 2021] DELETE /identity/v3/projects/ad75c90355234530bfc7a16598a46bd5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:46.763570 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683ce91-bd4a-4bd0-8cf8-deae9f99fc82 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:46.774815 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683ce91-bd4a-4bd0-8cf8-deae9f99fc82 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:46.889325 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63b2c2-8bd9-48ad-a9fc-d58ba6df56d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:46.891321 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63b2c2-8bd9-48ad-a9fc-d58ba6df56d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:46.892509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63b2c2-8bd9-48ad-a9fc-d58ba6df56d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:46.892509 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63b2c2-8bd9-48ad-a9fc-d58ba6df56d6 admin admin] PATH_INFO: `/v3/users/8045238c00764d15b628c7a35763bf00` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:46.896285 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63b2c2-8bd9-48ad-a9fc-d58ba6df56d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8045238c00764d15b628c7a35763bf00)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:46.900355 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63b2c2-8bd9-48ad-a9fc-d58ba6df56d6 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:46.988091 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2d63b2c2-8bd9-48ad-a9fc-d58ba6df56d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8045238c00764d15b628c7a35763bf00'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:47.002380 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2d63b2c2-8bd9-48ad-a9fc-d58ba6df56d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8045238c00764d15b628c7a35763bf00'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:47.003868 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2d63b2c2-8bd9-48ad-a9fc-d58ba6df56d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8045238c00764d15b628c7a35763bf00'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:47.021914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2d63b2c2-8bd9-48ad-a9fc-d58ba6df56d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8045238c00764d15b628c7a35763bf00'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:47.022764 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-2d63b2c2-8bd9-48ad-a9fc-d58ba6df56d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8045238c00764d15b628c7a35763bf00'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:47.038007 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1421/2822] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:46 2021] DELETE /identity/v3/users/8045238c00764d15b628c7a35763bf00 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:47.382945 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:47.386427 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:47.407833 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea44f6f-19bc-4d15-9e9e-bc2c8f5b3d59 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:47.477464 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:47.478723 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:47.478969 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:47.479217 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] PATH_INFO: `/v3/projects/4b8df23fe54346199222262cc0357a79` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:47.480475 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8df23fe54346199222262cc0357a79)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:47.482490 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:47.540456 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8df23fe54346199222262cc0357a79', 'request_id': 'req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:47.546857 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8df23fe54346199222262cc0357a79', 'request_id': 'req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:47.559296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8df23fe54346199222262cc0357a79', 'request_id': 'req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:47.570820 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] The token cache is being invalidate because project 4b8df23fe54346199222262cc0357a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:47.571108 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:47.571773 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-0acc0bbf-97e3-4662-a2ab-7cb00a23a5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:47.573567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1402/2823] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:47 2021] DELETE /identity/v3/projects/4b8df23fe54346199222262cc0357a79 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:47.579220 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968be7-972e-42d1-8214-f9bad8a609b0 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:47.579567 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968be7-972e-42d1-8214-f9bad8a609b0 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:47.579875 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968be7-972e-42d1-8214-f9bad8a609b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:47.600077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-64968be7-972e-42d1-8214-f9bad8a609b0 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:47.601534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-64968be7-972e-42d1-8214-f9bad8a609b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:47.664839 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1422/2824] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:47.673619 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f29d7-62bd-4edd-a799-6e38f1155391 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:47.674100 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f29d7-62bd-4edd-a799-6e38f1155391 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:47.674445 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f29d7-62bd-4edd-a799-6e38f1155391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:47.693715 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-e50f29d7-62bd-4edd-a799-6e38f1155391 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:47.695016 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e50f29d7-62bd-4edd-a799-6e38f1155391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:47.706477 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1403/2825] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:47.711255 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64968be7-972e-42d1-8214-f9bad8a609b0 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:47.721242 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64968be7-972e-42d1-8214-f9bad8a609b0 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:47.729908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88334ce4-f03c-4a0e-8d3a-fc6b838b9305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:47.730703 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88334ce4-f03c-4a0e-8d3a-fc6b838b9305 admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:47.731058 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88334ce4-f03c-4a0e-8d3a-fc6b838b9305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:47.731416 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88334ce4-f03c-4a0e-8d3a-fc6b838b9305 admin admin] PATH_INFO: `/v3/domains` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:47.732174 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88334ce4-f03c-4a0e-8d3a-fc6b838b9305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:45:47.732539 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88334ce4-f03c-4a0e-8d3a-fc6b838b9305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:47.734608 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88334ce4-f03c-4a0e-8d3a-fc6b838b9305 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:47.748895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1423/2826] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:45:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:45:47.753233 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f29d7-62bd-4edd-a799-6e38f1155391 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:47.763191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f29d7-62bd-4edd-a799-6e38f1155391 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:47.768014 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e143bc0-9df6-4743-8999-53302dc62bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:47.768697 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e143bc0-9df6-4743-8999-53302dc62bbb admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:47.768975 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e143bc0-9df6-4743-8999-53302dc62bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:47.769300 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e143bc0-9df6-4743-8999-53302dc62bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:47.770407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e143bc0-9df6-4743-8999-53302dc62bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:47.772842 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e143bc0-9df6-4743-8999-53302dc62bbb admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:47.801072 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1404/2827] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:47 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:47.803597 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88334ce4-f03c-4a0e-8d3a-fc6b838b9305 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:47.814439 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88334ce4-f03c-4a0e-8d3a-fc6b838b9305 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:47.874836 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4961e2-0d83-4d90-9d2c-1e39e61892d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:47.875500 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4961e2-0d83-4d90-9d2c-1e39e61892d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:47.876095 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4961e2-0d83-4d90-9d2c-1e39e61892d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:47.876216 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4961e2-0d83-4d90-9d2c-1e39e61892d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:47.876810 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4961e2-0d83-4d90-9d2c-1e39e61892d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:47.878787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4961e2-0d83-4d90-9d2c-1e39e61892d1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:47.900731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1424/2828] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:47 2021] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:47.904473 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e143bc0-9df6-4743-8999-53302dc62bbb admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:47.915569 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e143bc0-9df6-4743-8999-53302dc62bbb admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:47.920613 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb0721-a3e3-40ef-9773-d2f72781551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:47.921286 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb0721-a3e3-40ef-9773-d2f72781551c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:47.921563 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb0721-a3e3-40ef-9773-d2f72781551c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:47.921863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb0721-a3e3-40ef-9773-d2f72781551c admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:47.922595 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb0721-a3e3-40ef-9773-d2f72781551c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:47.924173 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb0721-a3e3-40ef-9773-d2f72781551c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:47.935937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1405/2829] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:47 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:47.939860 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4961e2-0d83-4d90-9d2c-1e39e61892d1 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:47.950937 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4961e2-0d83-4d90-9d2c-1e39e61892d1 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:47.955898 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e233801-bebe-419c-867a-8208d079c10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:47.956912 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e233801-bebe-419c-867a-8208d079c10f admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:47.957195 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e233801-bebe-419c-867a-8208d079c10f admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:47.957595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e233801-bebe-419c-867a-8208d079c10f admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:47.958565 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e233801-bebe-419c-867a-8208d079c10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:47.963305 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e233801-bebe-419c-867a-8208d079c10f admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:47.977043 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1425/2830] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:47 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:47.978476 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb0721-a3e3-40ef-9773-d2f72781551c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:47.988462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb0721-a3e3-40ef-9773-d2f72781551c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:47.993435 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2204a-3ae3-4b30-b809-c219287a6ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:47.994350 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2204a-3ae3-4b30-b809-c219287a6ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:47.994647 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2204a-3ae3-4b30-b809-c219287a6ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:47.994935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2204a-3ae3-4b30-b809-c219287a6ae7 admin admin] PATH_INFO: `/v3/projects/af14df4fc9b94da5b5ac0c999109bd32/users/a271706551c2468d9642050f074a189b/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:48.011224 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2204a-3ae3-4b30-b809-c219287a6ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af14df4fc9b94da5b5ac0c999109bd32, user_id=a271706551c2468d9642050f074a189b, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:48.013887 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2204a-3ae3-4b30-b809-c219287a6ae7 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:48.028819 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1406/2831] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:47 2021] PUT /identity/v3/projects/af14df4fc9b94da5b5ac0c999109bd32/users/a271706551c2468d9642050f074a189b/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:48.039503 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ab5e-c5a3-43d3-b7d2-e6bc8ffefc4f None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:48.039993 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ab5e-c5a3-43d3-b7d2-e6bc8ffefc4f None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:48.040462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ab5e-c5a3-43d3-b7d2-e6bc8ffefc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:48.066622 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2ab8ab5e-c5a3-43d3-b7d2-e6bc8ffefc4f None None] MFA Rules not processed for user `a271706551c2468d9642050f074a189b`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:48.068365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2ab8ab5e-c5a3-43d3-b7d2-e6bc8ffefc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:48.138338 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1426/2832] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:48 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:48.143533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2204a-3ae3-4b30-b809-c219287a6ae7 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:48.207296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2204a-3ae3-4b30-b809-c219287a6ae7 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:48.212692 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e8a5a-a4f3-49a6-974e-ac91883dc807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:48.213362 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e8a5a-a4f3-49a6-974e-ac91883dc807 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:48.213706 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e8a5a-a4f3-49a6-974e-ac91883dc807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:48.213957 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e8a5a-a4f3-49a6-974e-ac91883dc807 admin admin] PATH_INFO: `/v3/projects` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:48.214661 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e8a5a-a4f3-49a6-974e-ac91883dc807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:48.216603 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e8a5a-a4f3-49a6-974e-ac91883dc807 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:48.243463 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1407/2833] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:45:48 2021] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:48.247792 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8ab5e-c5a3-43d3-b7d2-e6bc8ffefc4f None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:48.260207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8ab5e-c5a3-43d3-b7d2-e6bc8ffefc4f None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:48.323488 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be76b75-0d5e-4bc5-8949-5f17b0d03e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:48.324163 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be76b75-0d5e-4bc5-8949-5f17b0d03e43 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:48.324449 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be76b75-0d5e-4bc5-8949-5f17b0d03e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:48.324727 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be76b75-0d5e-4bc5-8949-5f17b0d03e43 admin admin] PATH_INFO: `/v3/users` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:48.325434 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be76b75-0d5e-4bc5-8949-5f17b0d03e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:48.327381 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be76b75-0d5e-4bc5-8949-5f17b0d03e43 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:48.346967 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1427/2834] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:45:48 2021] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:45:48.351294 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e8a5a-a4f3-49a6-974e-ac91883dc807 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:48.361511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e8a5a-a4f3-49a6-974e-ac91883dc807 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:48.367703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e937eea-581f-45ad-9c31-321b5919412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:48.367703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e937eea-581f-45ad-9c31-321b5919412c admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:48.367703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e937eea-581f-45ad-9c31-321b5919412c admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:48.368115 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e937eea-581f-45ad-9c31-321b5919412c admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:48.368789 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e937eea-581f-45ad-9c31-321b5919412c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:48.370495 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e937eea-581f-45ad-9c31-321b5919412c admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:48.385001 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1408/2835] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:48.387075 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be76b75-0d5e-4bc5-8949-5f17b0d03e43 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:48.399152 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be76b75-0d5e-4bc5-8949-5f17b0d03e43 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:48.404868 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16cf7-0a71-4b1b-91ba-31112b05a3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:48.405431 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16cf7-0a71-4b1b-91ba-31112b05a3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:48.405705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16cf7-0a71-4b1b-91ba-31112b05a3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:48.406005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16cf7-0a71-4b1b-91ba-31112b05a3bf admin admin] PATH_INFO: `/v3/projects/5f54901e014445969f450e46fd5089d6/users/255d78dac49b481286b741630c44e95c/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:48.422578 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16cf7-0a71-4b1b-91ba-31112b05a3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f54901e014445969f450e46fd5089d6, user_id=255d78dac49b481286b741630c44e95c, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:48.425318 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16cf7-0a71-4b1b-91ba-31112b05a3bf admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:48.439878 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1428/2836] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:48 2021] PUT /identity/v3/projects/5f54901e014445969f450e46fd5089d6/users/255d78dac49b481286b741630c44e95c/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:48.445322 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e937eea-581f-45ad-9c31-321b5919412c admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:48.455263 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e937eea-581f-45ad-9c31-321b5919412c admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:48.514360 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38baf9-e092-46e9-b297-848b15209397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:48.515040 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38baf9-e092-46e9-b297-848b15209397 admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:48.515319 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38baf9-e092-46e9-b297-848b15209397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:48.515593 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38baf9-e092-46e9-b297-848b15209397 admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:48.516352 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38baf9-e092-46e9-b297-848b15209397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:48.517992 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38baf9-e092-46e9-b297-848b15209397 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:48.531191 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1409/2837] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:45:48 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:45:48.534275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16cf7-0a71-4b1b-91ba-31112b05a3bf admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:48.545372 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16cf7-0a71-4b1b-91ba-31112b05a3bf admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:48.550110 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ea693-314c-4a5e-9489-b40760322a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:48.550997 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ea693-314c-4a5e-9489-b40760322a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:48.551275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ea693-314c-4a5e-9489-b40760322a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:48.551548 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ea693-314c-4a5e-9489-b40760322a33 admin admin] PATH_INFO: `/v3/projects/5f54901e014445969f450e46fd5089d6/users/255d78dac49b481286b741630c44e95c/roles/a312b345efeb490eb4234d1ace386dec` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:48.553559 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ea693-314c-4a5e-9489-b40760322a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f54901e014445969f450e46fd5089d6, user_id=255d78dac49b481286b741630c44e95c, role_id=a312b345efeb490eb4234d1ace386dec)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:48.556209 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ea693-314c-4a5e-9489-b40760322a33 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:48.570146 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1429/2838] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:45:48 2021] PUT /identity/v3/projects/5f54901e014445969f450e46fd5089d6/users/255d78dac49b481286b741630c44e95c/roles/a312b345efeb490eb4234d1ace386dec => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:45:48.581313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798da18-373e-4753-a5fc-0324954d1580 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:48.581607 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798da18-373e-4753-a5fc-0324954d1580 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:48.581997 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798da18-373e-4753-a5fc-0324954d1580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:48.611664 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-b798da18-373e-4753-a5fc-0324954d1580 None None] MFA Rules not processed for user `255d78dac49b481286b741630c44e95c`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:48.612877 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b798da18-373e-4753-a5fc-0324954d1580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:48.683799 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1410/2839] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:48 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:48.695165 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ea693-314c-4a5e-9489-b40760322a33 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:48.697596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-ea6ea693-314c-4a5e-9489-b40760322a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:48.764765 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ea693-314c-4a5e-9489-b40760322a33 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:48.768679 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35084ad9-7ee2-4bf1-9cc1-fb2f8e6147de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:48.769329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35084ad9-7ee2-4bf1-9cc1-fb2f8e6147de service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:48.769610 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35084ad9-7ee2-4bf1-9cc1-fb2f8e6147de service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:48.769909 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35084ad9-7ee2-4bf1-9cc1-fb2f8e6147de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:48.831579 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35084ad9-7ee2-4bf1-9cc1-fb2f8e6147de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:48.833692 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35084ad9-7ee2-4bf1-9cc1-fb2f8e6147de service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:48.845112 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1430/2840] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:48 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:53.029034 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798da18-373e-4753-a5fc-0324954d1580 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:53.030596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-b798da18-373e-4753-a5fc-0324954d1580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:53.042602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798da18-373e-4753-a5fc-0324954d1580 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:53.046192 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d500f7c-2bad-46fe-85d6-ee05f0d961e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:53.046839 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500f7c-2bad-46fe-85d6-ee05f0d961e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:53.047120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500f7c-2bad-46fe-85d6-ee05f0d961e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:53.047395 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500f7c-2bad-46fe-85d6-ee05f0d961e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:53.057320 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d500f7c-2bad-46fe-85d6-ee05f0d961e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:53.058841 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d500f7c-2bad-46fe-85d6-ee05f0d961e9 service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:53.069120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1411/2841] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:53 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:57.930863 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35084ad9-7ee2-4bf1-9cc1-fb2f8e6147de service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:57.992787 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35084ad9-7ee2-4bf1-9cc1-fb2f8e6147de service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:57.997254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:57.998179 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:57.998459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:57.998732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] PATH_INFO: `/v3/users/a271706551c2468d9642050f074a189b` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:57.999954 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a271706551c2468d9642050f074a189b)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:58.001904 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:58.048453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a271706551c2468d9642050f074a189b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.055616 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a271706551c2468d9642050f074a189b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.056275 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a271706551c2468d9642050f074a189b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.067564 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a271706551c2468d9642050f074a189b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.068786 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a271706551c2468d9642050f074a189b'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.080478 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1431/2842] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:57 2021] DELETE /identity/v3/users/a271706551c2468d9642050f074a189b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:58.084987 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e54a-a051-4002-aee1-cdaef6fa3395 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:58.085453 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e54a-a051-4002-aee1-cdaef6fa3395 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:58.085567 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e54a-a051-4002-aee1-cdaef6fa3395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:58.104545 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-78b5e54a-a051-4002-aee1-cdaef6fa3395 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:45:58.106288 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-78b5e54a-a051-4002-aee1-cdaef6fa3395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:58.164229 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1412/2843] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:45:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:45:58.173885 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:58.175292 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:58.231962 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694a8d3-1f6d-42a6-bd6a-e78b94be94f5 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:58.235602 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650a5a8-691d-45d8-bd53-0f3b47d272a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:58.236237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a5a8-691d-45d8-bd53-0f3b47d272a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:58.236515 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a5a8-691d-45d8-bd53-0f3b47d272a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:58.236790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a5a8-691d-45d8-bd53-0f3b47d272a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:58.246150 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650a5a8-691d-45d8-bd53-0f3b47d272a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:58.247498 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650a5a8-691d-45d8-bd53-0f3b47d272a1 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:58.257237 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1432/2844] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:58.531376 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5e54a-a051-4002-aee1-cdaef6fa3395 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:58.532781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-78b5e54a-a051-4002-aee1-cdaef6fa3395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:58.545441 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5e54a-a051-4002-aee1-cdaef6fa3395 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:58.550104 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:58.551038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:58.551315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:58.551584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] PATH_INFO: `/v3/projects/af14df4fc9b94da5b5ac0c999109bd32` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:58.553346 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af14df4fc9b94da5b5ac0c999109bd32)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:58.555269 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:58.598396 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af14df4fc9b94da5b5ac0c999109bd32', 'request_id': 'req-31d16e15-af5f-4b01-a96f-69a289832da1'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.604979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af14df4fc9b94da5b5ac0c999109bd32', 'request_id': 'req-31d16e15-af5f-4b01-a96f-69a289832da1'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.611994 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af14df4fc9b94da5b5ac0c999109bd32', 'request_id': 'req-31d16e15-af5f-4b01-a96f-69a289832da1'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.622735 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] The token cache is being invalidate because project af14df4fc9b94da5b5ac0c999109bd32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:58.623046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.623716 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.625314 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1413/2845] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:58 2021] DELETE /identity/v3/projects/af14df4fc9b94da5b5ac0c999109bd32 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:58.632689 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650a5a8-691d-45d8-bd53-0f3b47d272a1 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:58.645197 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650a5a8-691d-45d8-bd53-0f3b47d272a1 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:58.702806 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:58.703680 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:58.703963 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:58.704240 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] PATH_INFO: `/v3/users/255d78dac49b481286b741630c44e95c` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:58.705465 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=255d78dac49b481286b741630c44e95c)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:58.707650 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:58.758996 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255d78dac49b481286b741630c44e95c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.766266 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255d78dac49b481286b741630c44e95c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.766960 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255d78dac49b481286b741630c44e95c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.779777 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255d78dac49b481286b741630c44e95c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.780422 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255d78dac49b481286b741630c44e95c'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:58.794691 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1433/2846] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:45:58 2021] DELETE /identity/v3/users/255d78dac49b481286b741630c44e95c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:45:58.897185 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:58.898921 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:58.968963 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d16e15-af5f-4b01-a96f-69a289832da1 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:59.025659 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239b6b1-ba03-4375-9ac5-ffa55e92568d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:59.026264 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239b6b1-ba03-4375-9ac5-ffa55e92568d service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:59.026544 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239b6b1-ba03-4375-9ac5-ffa55e92568d service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:59.027070 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239b6b1-ba03-4375-9ac5-ffa55e92568d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:59.028838 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d239b6b1-ba03-4375-9ac5-ffa55e92568d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:59.089605 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:45:59.091137 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:45:59.097412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239b6b1-ba03-4375-9ac5-ffa55e92568d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:59.099578 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239b6b1-ba03-4375-9ac5-ffa55e92568d service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:59.110552 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1414/2847] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:45:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:45:59.122894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdbddf-80de-44dc-be3b-49fefb7bbe84 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:45:59.130534 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:45:59.131551 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:45:59.132013 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:45:59.132374 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] PATH_INFO: `/v3/projects/5f54901e014445969f450e46fd5089d6` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:45:59.133671 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f54901e014445969f450e46fd5089d6)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:45:59.135690 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:45:59.189959 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f54901e014445969f450e46fd5089d6', 'request_id': 'req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:59.197050 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f54901e014445969f450e46fd5089d6', 'request_id': 'req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:59.207376 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f54901e014445969f450e46fd5089d6', 'request_id': 'req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:59.222247 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] The token cache is being invalidate because project 5f54901e014445969f450e46fd5089d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:45:59.222507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:59.224452 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:45:59.225585 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1434/2848] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:45:59 2021] DELETE /identity/v3/projects/5f54901e014445969f450e46fd5089d6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:46:05.451341 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239b6b1-ba03-4375-9ac5-ffa55e92568d service neutron] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:05.452924 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-d239b6b1-ba03-4375-9ac5-ffa55e92568d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:05.466703 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239b6b1-ba03-4375-9ac5-ffa55e92568d service neutron] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:05.520714 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:05.521629 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:05.521935 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:05.522205 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] PATH_INFO: `/v3/users/7e3a3afdfc4c44a29d0f3df50a5ed2ac` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:05.523386 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3a3afdfc4c44a29d0f3df50a5ed2ac)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:05.525290 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:05.572153 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3a3afdfc4c44a29d0f3df50a5ed2ac'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:05.579061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3a3afdfc4c44a29d0f3df50a5ed2ac'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:05.587432 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3a3afdfc4c44a29d0f3df50a5ed2ac'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:05.599301 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3a3afdfc4c44a29d0f3df50a5ed2ac'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:05.599878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3a3afdfc4c44a29d0f3df50a5ed2ac'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:05.606019 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1415/2849] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:46:05 2021] DELETE /identity/v3/users/7e3a3afdfc4c44a29d0f3df50a5ed2ac => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:46:05.776737 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:05.778295 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:05.791782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f41961-b8d7-4eba-a7a6-c491a6bb55be admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:05.848471 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:05.849895 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:05.850177 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:05.850461 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] PATH_INFO: `/v3/projects/c0da9050a08e442887ca8dc346374836` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:05.851901 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0da9050a08e442887ca8dc346374836)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:05.853868 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:05.899566 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0da9050a08e442887ca8dc346374836', 'request_id': 'req-1fa3f399-fe31-4d8a-ad11-1b061ac59249'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:05.906329 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0da9050a08e442887ca8dc346374836', 'request_id': 'req-1fa3f399-fe31-4d8a-ad11-1b061ac59249'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:05.917561 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0da9050a08e442887ca8dc346374836', 'request_id': 'req-1fa3f399-fe31-4d8a-ad11-1b061ac59249'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:05.933879 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] The token cache is being invalidate because project c0da9050a08e442887ca8dc346374836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:46:05.934166 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:05.934842 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:05.936379 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1435/2850] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:46:05 2021] DELETE /identity/v3/projects/c0da9050a08e442887ca8dc346374836 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:46:05.940597 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:05.942045 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:05.954937 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fd584-cafa-4760-96ab-e622fb5ddf95 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:06.012366 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:06.013245 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:06.013526 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:06.013826 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] PATH_INFO: `/v3/users/1342900282fd4bdcaac541eaa6a3834b` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:06.015022 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1342900282fd4bdcaac541eaa6a3834b)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:06.016978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:06.064391 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1342900282fd4bdcaac541eaa6a3834b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:06.071662 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1342900282fd4bdcaac541eaa6a3834b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:06.078608 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1342900282fd4bdcaac541eaa6a3834b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:06.091666 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1342900282fd4bdcaac541eaa6a3834b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:06.092331 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1342900282fd4bdcaac541eaa6a3834b'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:06.099038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1416/2851] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:46:05 2021] DELETE /identity/v3/users/1342900282fd4bdcaac541eaa6a3834b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:46:06.267714 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:06.269159 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:06.283224 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3f399-fe31-4d8a-ad11-1b061ac59249 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:06.340160 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:06.341024 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:06.341304 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:06.341577 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] PATH_INFO: `/v3/projects/9625cc6c79ee42cca4b0b0cc8cd55db6` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:06.342888 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9625cc6c79ee42cca4b0b0cc8cd55db6)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:06.344718 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:06.389180 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9625cc6c79ee42cca4b0b0cc8cd55db6', 'request_id': 'req-c98d08db-2a56-453b-94ef-38b4e5aebe71'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:06.395144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9625cc6c79ee42cca4b0b0cc8cd55db6', 'request_id': 'req-c98d08db-2a56-453b-94ef-38b4e5aebe71'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:06.402339 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9625cc6c79ee42cca4b0b0cc8cd55db6', 'request_id': 'req-c98d08db-2a56-453b-94ef-38b4e5aebe71'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:06.412657 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] The token cache is being invalidate because project 9625cc6c79ee42cca4b0b0cc8cd55db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:46:06.412939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:06.413550 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-c98d08db-2a56-453b-94ef-38b4e5aebe71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:06.415087 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1436/2852] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:46:06 2021] DELETE /identity/v3/projects/9625cc6c79ee42cca4b0b0cc8cd55db6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:46:09.263815 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:09.265353 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:09.278596 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1a884-eae9-425f-bfa7-1a997ce56d19 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:09.335876 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:09.336763 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:09.337046 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:09.337328 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] PATH_INFO: `/v3/users/bfd00943afce4831971917b72228b4f7` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:09.338556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd00943afce4831971917b72228b4f7)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:09.340487 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:09.388765 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd00943afce4831971917b72228b4f7'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:09.396020 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd00943afce4831971917b72228b4f7'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:09.403676 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd00943afce4831971917b72228b4f7'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:09.416067 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd00943afce4831971917b72228b4f7'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:09.416746 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd00943afce4831971917b72228b4f7'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:09.422727 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1417/2853] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:46:09 2021] DELETE /identity/v3/users/bfd00943afce4831971917b72228b4f7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:46:09.427250 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59adfc-5f42-43e0-aa57-bd6947cffc2b None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:09.428263 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59adfc-5f42-43e0-aa57-bd6947cffc2b None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:09.428365 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59adfc-5f42-43e0-aa57-bd6947cffc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:09.446280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-4a59adfc-5f42-43e0-aa57-bd6947cffc2b None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:46:09.447460 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4a59adfc-5f42-43e0-aa57-bd6947cffc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:09.503308 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1437/2854] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:46:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:46:09.513855 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:09.515242 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:09.569383 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86511a9c-9ff2-4817-aa37-088234f4fe65 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:09.572993 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceda9d-40ed-4f79-addd-79dd463ce06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:09.573623 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceda9d-40ed-4f79-addd-79dd463ce06a service neutron] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:09.573934 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceda9d-40ed-4f79-addd-79dd463ce06a service neutron] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:09.574204 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceda9d-40ed-4f79-addd-79dd463ce06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:09.583032 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ceda9d-40ed-4f79-addd-79dd463ce06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:09.584465 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ceda9d-40ed-4f79-addd-79dd463ce06a service neutron] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:09.593548 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1418/2855] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:46:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:46:09.852529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59adfc-5f42-43e0-aa57-bd6947cffc2b None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:09.854084 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-4a59adfc-5f42-43e0-aa57-bd6947cffc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:09.866706 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59adfc-5f42-43e0-aa57-bd6947cffc2b None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:09.871426 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:09.872412 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:09.872759 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:09.873099 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] PATH_INFO: `/v3/projects/558b06e21f904c4a9453e568d181a57c` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:09.874398 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=558b06e21f904c4a9453e568d181a57c)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:09.876492 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:09.921939 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '558b06e21f904c4a9453e568d181a57c', 'request_id': 'req-d70e620b-3a48-4155-888e-e57e344e43b1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:09.928430 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '558b06e21f904c4a9453e568d181a57c', 'request_id': 'req-d70e620b-3a48-4155-888e-e57e344e43b1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:09.935448 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '558b06e21f904c4a9453e568d181a57c', 'request_id': 'req-d70e620b-3a48-4155-888e-e57e344e43b1'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:09.945570 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] The token cache is being invalidate because project 558b06e21f904c4a9453e568d181a57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:46:09.945885 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:09.946507 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-d70e620b-3a48-4155-888e-e57e344e43b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:46:09.948077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1438/2856] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:46:09 2021] DELETE /identity/v3/projects/558b06e21f904c4a9453e568d181a57c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:46:09.953979 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9328-259e-4c09-bca0-96586c1d98e7 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:09.954265 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9328-259e-4c09-bca0-96586c1d98e7 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:09.954542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9328-259e-4c09-bca0-96586c1d98e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:09.971973 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-187e9328-259e-4c09-bca0-96586c1d98e7 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:46:09.973160 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-187e9328-259e-4c09-bca0-96586c1d98e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:10.034788 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1419/2857] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:46:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:46:10.038828 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791681b-3d1c-4948-b94e-dee57cc55d28 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:10.039117 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791681b-3d1c-4948-b94e-dee57cc55d28 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:10.039395 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791681b-3d1c-4948-b94e-dee57cc55d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:10.057462 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2791681b-3d1c-4948-b94e-dee57cc55d28 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:46:10.058685 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2791681b-3d1c-4948-b94e-dee57cc55d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:10.066495 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1439/2858] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:46:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:46:10.070793 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e9328-259e-4c09-bca0-96586c1d98e7 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:10.080313 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e9328-259e-4c09-bca0-96586c1d98e7 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:10.085359 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48d550-6a83-4673-ba59-8b12c7185f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:10.086038 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48d550-6a83-4673-ba59-8b12c7185f1d admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:10.086315 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48d550-6a83-4673-ba59-8b12c7185f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:10.086584 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48d550-6a83-4673-ba59-8b12c7185f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:10.087336 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48d550-6a83-4673-ba59-8b12c7185f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:46:10.087638 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48d550-6a83-4673-ba59-8b12c7185f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:10.089210 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48d550-6a83-4673-ba59-8b12c7185f1d admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:10.100978 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1420/2859] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Dec 15 13:46:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:46:10.105386 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791681b-3d1c-4948-b94e-dee57cc55d28 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:10.114401 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791681b-3d1c-4948-b94e-dee57cc55d28 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:10.119072 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb4a0e-a0ce-4bc6-88f5-17699d899275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:10.119710 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb4a0e-a0ce-4bc6-88f5-17699d899275 admin admin] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:10.119990 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb4a0e-a0ce-4bc6-88f5-17699d899275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:10.120257 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb4a0e-a0ce-4bc6-88f5-17699d899275 admin admin] PATH_INFO: `/v3/projects` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:10.120955 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb4a0e-a0ce-4bc6-88f5-17699d899275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:10.123006 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb4a0e-a0ce-4bc6-88f5-17699d899275 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:10.147736 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1440/2860] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Dec 15 13:46:10 2021] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:46:10.151821 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48d550-6a83-4673-ba59-8b12c7185f1d admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:10.161398 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48d550-6a83-4673-ba59-8b12c7185f1d admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:10.214948 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986fbcb-6b99-45ba-8063-322b2355c957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:10.215600 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986fbcb-6b99-45ba-8063-322b2355c957 admin admin] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:10.215878 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986fbcb-6b99-45ba-8063-322b2355c957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:10.216147 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986fbcb-6b99-45ba-8063-322b2355c957 admin admin] PATH_INFO: `/v3/users` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:10.216875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986fbcb-6b99-45ba-8063-322b2355c957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:10.218843 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986fbcb-6b99-45ba-8063-322b2355c957 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:10.238425 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1421/2861] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Dec 15 13:46:10 2021] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:46:10.242705 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb4a0e-a0ce-4bc6-88f5-17699d899275 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:10.252817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb4a0e-a0ce-4bc6-88f5-17699d899275 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:10.257366 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cce021-cfb2-4471-96fd-76d05863038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:10.258053 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce021-cfb2-4471-96fd-76d05863038e admin admin] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:10.258333 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce021-cfb2-4471-96fd-76d05863038e admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:10.258607 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce021-cfb2-4471-96fd-76d05863038e admin admin] PATH_INFO: `/v3/roles` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:10.259337 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cce021-cfb2-4471-96fd-76d05863038e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:10.260908 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cce021-cfb2-4471-96fd-76d05863038e admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:10.270981 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1441/2862] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:46:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:46:10.275309 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986fbcb-6b99-45ba-8063-322b2355c957 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:10.285283 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986fbcb-6b99-45ba-8063-322b2355c957 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:10.290556 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffa6ab-33bd-4550-9b1d-7b17b50b5e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:10.291232 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa6ab-33bd-4550-9b1d-7b17b50b5e2a admin admin] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:10.291509 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa6ab-33bd-4550-9b1d-7b17b50b5e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:10.291781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa6ab-33bd-4550-9b1d-7b17b50b5e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:10.292511 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffa6ab-33bd-4550-9b1d-7b17b50b5e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:10.294120 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffa6ab-33bd-4550-9b1d-7b17b50b5e2a admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:10.303909 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1422/2863] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Dec 15 13:46:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:46:10.307817 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cce021-cfb2-4471-96fd-76d05863038e admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:10.317289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cce021-cfb2-4471-96fd-76d05863038e admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:10.321873 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d2b3-6988-4203-9be5-7efda9b87451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:10.322731 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d2b3-6988-4203-9be5-7efda9b87451 admin admin] REQUEST_METHOD: `PUT` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:10.323005 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d2b3-6988-4203-9be5-7efda9b87451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:10.323273 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d2b3-6988-4203-9be5-7efda9b87451 admin admin] PATH_INFO: `/v3/projects/a6ee752240d24f6985d8247a0cf949d3/users/b0ae2089722840cbb6a10b84f1ac08ed/roles/78401ee743b448d48b6c94ff8642907e` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:10.337865 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450d2b3-6988-4203-9be5-7efda9b87451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ee752240d24f6985d8247a0cf949d3, user_id=b0ae2089722840cbb6a10b84f1ac08ed, role_id=78401ee743b448d48b6c94ff8642907e)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:10.340459 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450d2b3-6988-4203-9be5-7efda9b87451 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:10.353808 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1442/2864] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Dec 15 13:46:10 2021] PUT /identity/v3/projects/a6ee752240d24f6985d8247a0cf949d3/users/b0ae2089722840cbb6a10b84f1ac08ed/roles/78401ee743b448d48b6c94ff8642907e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:46:10.358863 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aef0c-d1ce-4963-8140-752e03a90188 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:10.359154 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aef0c-d1ce-4963-8140-752e03a90188 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:10.359433 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aef0c-d1ce-4963-8140-752e03a90188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:10.376853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-801aef0c-d1ce-4963-8140-752e03a90188 None None] MFA Rules not processed for user `df51193f4ede4e77a3f00ac4e0205892`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:46:10.378141 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-801aef0c-d1ce-4963-8140-752e03a90188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:10.435541 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1423/2865] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:46:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:46:10.446569 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d2b3-6988-4203-9be5-7efda9b87451 admin admin] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:10.448320 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-9450d2b3-6988-4203-9be5-7efda9b87451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:10.504193 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d2b3-6988-4203-9be5-7efda9b87451 admin admin] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:10.508440 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52457a36-1e74-47ce-aea8-1a78f1139817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:10.509081 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457a36-1e74-47ce-aea8-1a78f1139817 service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:10.509358 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457a36-1e74-47ce-aea8-1a78f1139817 service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:10.509636 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457a36-1e74-47ce-aea8-1a78f1139817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:10.518563 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52457a36-1e74-47ce-aea8-1a78f1139817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:10.519982 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52457a36-1e74-47ce-aea8-1a78f1139817 service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:10.529825 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1443/2866] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:46:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:46:11.180679 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4665e-1fb9-482d-b865-96aa55ed9d42 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:11.180964 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4665e-1fb9-482d-b865-96aa55ed9d42 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:11.181241 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4665e-1fb9-482d-b865-96aa55ed9d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:11.207570 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-c7c4665e-1fb9-482d-b865-96aa55ed9d42 None None] MFA Rules not processed for user `b0ae2089722840cbb6a10b84f1ac08ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:46:11.208830 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-c7c4665e-1fb9-482d-b865-96aa55ed9d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:11.276127 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1424/2867] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:46:11 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:46:11.288337 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52457a36-1e74-47ce-aea8-1a78f1139817 service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:11.289782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-52457a36-1e74-47ce-aea8-1a78f1139817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:11.348121 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52457a36-1e74-47ce-aea8-1a78f1139817 service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:11.352571 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb25564-398b-4303-83df-797ca0abc557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:11.353207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25564-398b-4303-83df-797ca0abc557 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:11.353487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25564-398b-4303-83df-797ca0abc557 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:11.353782 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25564-398b-4303-83df-797ca0abc557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:11.361894 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb25564-398b-4303-83df-797ca0abc557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:11.363307 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb25564-398b-4303-83df-797ca0abc557 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:11.372453 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1444/2868] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:46:11 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:46:12.696412 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844649-9501-435a-b5a2-71f57c73ac63 None None] REQUEST_METHOD: `POST` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:12.696898 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844649-9501-435a-b5a2-71f57c73ac63 None None] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:12.697039 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844649-9501-435a-b5a2-71f57c73ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:12.714856 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.auth.core [None req-34844649-9501-435a-b5a2-71f57c73ac63 None None] MFA Rules not processed for user `b0ae2089722840cbb6a10b84f1ac08ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:46:12.716044 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-34844649-9501-435a-b5a2-71f57c73ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:12.722765 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1425/2869] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:46:12 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:46:39.854790 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb25564-398b-4303-83df-797ca0abc557 service cinder] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:46:39.863404 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb25564-398b-4303-83df-797ca0abc557 service cinder] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:46:39.867109 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8036d1-83a7-4f5c-9bf8-c1551ece3750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:46:39.867740 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8036d1-83a7-4f5c-9bf8-c1551ece3750 service cinder] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:46:39.868021 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8036d1-83a7-4f5c-9bf8-c1551ece3750 service cinder] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:46:39.868294 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8036d1-83a7-4f5c-9bf8-c1551ece3750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:46:39.870077 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-eb8036d1-83a7-4f5c-9bf8-c1551ece3750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:46:39.939482 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8036d1-83a7-4f5c-9bf8-c1551ece3750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:46:39.940905 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8036d1-83a7-4f5c-9bf8-c1551ece3750 service cinder] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:46:39.952530 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1445/2870] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:46:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:47:02.694671 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844649-9501-435a-b5a2-71f57c73ac63 None None] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:47:02.696061 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-34844649-9501-435a-b5a2-71f57c73ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:02.708011 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844649-9501-435a-b5a2-71f57c73ac63 None None] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:47:02.712097 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982bc54-abee-444b-ac97-59bda97fb31c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63a5db2990424915ac1daf36d14a733b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:47:02.712737 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982bc54-abee-444b-ac97-59bda97fb31c service cinder] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:47:02.713017 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982bc54-abee-444b-ac97-59bda97fb31c service cinder] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:47:02.713290 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982bc54-abee-444b-ac97-59bda97fb31c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:47:02.715066 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e982bc54-abee-444b-ac97-59bda97fb31c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:02.728850 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982bc54-abee-444b-ac97-59bda97fb31c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:47:02.730326 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982bc54-abee-444b-ac97-59bda97fb31c service cinder] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:47:02.741005 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1426/2871] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:47:02 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:47:15.245595 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d1e0-7f7e-4b5c-b916-961bfde4f394 None None] REQUEST_METHOD: `POST` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:47:15.246144 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d1e0-7f7e-4b5c-b916-961bfde4f394 None None] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:47:15.246254 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d1e0-7f7e-4b5c-b916-961bfde4f394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:47:15.264019 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.auth.core [None req-2a02d1e0-7f7e-4b5c-b916-961bfde4f394 None None] MFA Rules not processed for user `b0ae2089722840cbb6a10b84f1ac08ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:47:15.265206 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2a02d1e0-7f7e-4b5c-b916-961bfde4f394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:15.272025 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1446/2872] 10.222.0.83 () {58 vars in 957 bytes} [Wed Dec 15 13:47:15 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:47:15.812076 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982bc54-abee-444b-ac97-59bda97fb31c service cinder] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:47:15.813510 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e982bc54-abee-444b-ac97-59bda97fb31c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:15.883201 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982bc54-abee-444b-ac97-59bda97fb31c service cinder] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:47:15.888137 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fb307-783a-4443-9c5a-6de3115ad9f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b1d42ac3a427bb084740a069b577d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:47:15.888782 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb307-783a-4443-9c5a-6de3115ad9f1 service placement] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:47:15.889060 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb307-783a-4443-9c5a-6de3115ad9f1 service placement] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:47:15.889333 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb307-783a-4443-9c5a-6de3115ad9f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:47:15.891226 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fe2fb307-783a-4443-9c5a-6de3115ad9f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:15.903067 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fb307-783a-4443-9c5a-6de3115ad9f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:47:15.904630 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fb307-783a-4443-9c5a-6de3115ad9f1 service placement] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:47:15.914392 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1427/2873] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:47:15 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:47:17.412965 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d1e0-7f7e-4b5c-b916-961bfde4f394 None None] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:47:17.414425 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-2a02d1e0-7f7e-4b5c-b916-961bfde4f394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:17.426062 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d1e0-7f7e-4b5c-b916-961bfde4f394 None None] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:47:17.429529 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787cca5-6c71-4610-a174-53488b29383e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1632f6a5414d2abfdee3b5bdd941cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:47:17.430194 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787cca5-6c71-4610-a174-53488b29383e service neutron] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:47:17.430977 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787cca5-6c71-4610-a174-53488b29383e service neutron] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:47:17.431249 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787cca5-6c71-4610-a174-53488b29383e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:47:17.432914 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-0787cca5-6c71-4610-a174-53488b29383e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:17.441931 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787cca5-6c71-4610-a174-53488b29383e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:47:17.443332 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787cca5-6c71-4610-a174-53488b29383e service neutron] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:47:17.451732 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1447/2874] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:47:17 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:47:24.128500 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fb307-783a-4443-9c5a-6de3115ad9f1 service placement] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:47:24.130128 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-fe2fb307-783a-4443-9c5a-6de3115ad9f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:24.146296 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fb307-783a-4443-9c5a-6de3115ad9f1 service placement] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:47:24.152484 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a628e7-3cf2-45e2-8e39-f32cf24f0c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:47:24.153129 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a628e7-3cf2-45e2-8e39-f32cf24f0c54 service nova] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:47:24.153407 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a628e7-3cf2-45e2-8e39-f32cf24f0c54 service nova] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:47:24.153680 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a628e7-3cf2-45e2-8e39-f32cf24f0c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:47:24.155462 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-61a628e7-3cf2-45e2-8e39-f32cf24f0c54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:24.168481 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a628e7-3cf2-45e2-8e39-f32cf24f0c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:47:24.170009 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a628e7-3cf2-45e2-8e39-f32cf24f0c54 service nova] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:47:24.180271 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1428/2875] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:47:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:47:48.157623 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787cca5-6c71-4610-a174-53488b29383e service neutron] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:47:48.171626 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787cca5-6c71-4610-a174-53488b29383e service neutron] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:47:48.179282 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc113f5-b1ba-48d9-9ece-d3a890ff72ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34b3d2f67b1477598acce389819c70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:47:48.179906 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc113f5-b1ba-48d9-9ece-d3a890ff72ad service nova] REQUEST_METHOD: `GET` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:47:48.180208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc113f5-b1ba-48d9-9ece-d3a890ff72ad service nova] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:47:48.180481 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc113f5-b1ba-48d9-9ece-d3a890ff72ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:47:48.182301 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.fernet_utils [None req-bbc113f5-b1ba-48d9-9ece-d3a890ff72ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:47:48.194807 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc113f5-b1ba-48d9-9ece-d3a890ff72ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:47:48.196402 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc113f5-b1ba-48d9-9ece-d3a890ff72ad service nova] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:47:48.207757 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1448/2876] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:47:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:48:13.044259 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a628e7-3cf2-45e2-8e39-f32cf24f0c54 service nova] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:48:13.054962 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a628e7-3cf2-45e2-8e39-f32cf24f0c54 service nova] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:48:13.059589 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:48:13.060853 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:48:13.061251 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:48:13.061542 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] PATH_INFO: `/v3/users/b0ae2089722840cbb6a10b84f1ac08ed` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:48:13.062794 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ae2089722840cbb6a10b84f1ac08ed)` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:48:13.064702 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:48:13.109670 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ae2089722840cbb6a10b84f1ac08ed'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:48:13.116169 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ae2089722840cbb6a10b84f1ac08ed'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:48:13.123327 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ae2089722840cbb6a10b84f1ac08ed'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:48:13.135053 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ae2089722840cbb6a10b84f1ac08ed'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:48:13.135678 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.notifications [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ae2089722840cbb6a10b84f1ac08ed'} {{(pid=79139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:48:13.141533 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1429/2877] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Dec 15 13:48:13 2021] DELETE /identity/v3/users/b0ae2089722840cbb6a10b84f1ac08ed => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:48:13.308924 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc113f5-b1ba-48d9-9ece-d3a890ff72ad service nova] Authenticating user token {{(pid=79140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:48:13.319280 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc113f5-b1ba-48d9-9ece-d3a890ff72ad service nova] Validating token access rules against request {{(pid=79140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:48:13.374784 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df51193f4ede4e77a3f00ac4e0205892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f70e030dc594b37825ba3900598d4c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:48:13.375560 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:48:13.375840 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:48:13.376115 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] PATH_INFO: `/v3/projects/a6ee752240d24f6985d8247a0cf949d3` {{(pid=79140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:48:13.377289 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ee752240d24f6985d8247a0cf949d3)` {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:48:13.379208 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] RBAC: Authorization granted {{(pid=79140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:48:13.422513 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ee752240d24f6985d8247a0cf949d3', 'request_id': 'req-196b726a-3df1-4dba-99ad-a11462fe2e60'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:48:13.428283 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ee752240d24f6985d8247a0cf949d3', 'request_id': 'req-196b726a-3df1-4dba-99ad-a11462fe2e60'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:48:13.435832 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ee752240d24f6985d8247a0cf949d3', 'request_id': 'req-196b726a-3df1-4dba-99ad-a11462fe2e60'} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:48:13.446207 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] The token cache is being invalidate because project a6ee752240d24f6985d8247a0cf949d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:48:13.446487 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:48:13.447101 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: DEBUG keystone.notifications [None req-196b726a-3df1-4dba-99ad-a11462fe2e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:48:13.448596 dv-cinder-813228-4-iscsi devstack@keystone.service[79140]: [pid: 79140|app: 0|req: 1449/2878] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Dec 15 13:48:13 2021] DELETE /identity/v3/projects/a6ee752240d24f6985d8247a0cf949d3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:50:42.128823 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] Authenticating user token {{(pid=79139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:50:42.130394 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:50:42.275875 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b695ab-fb8c-43cb-907e-378e19133591 admin admin] Validating token access rules against request {{(pid=79139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:50:42.332602 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0929794-4889-436f-97f2-84f98571cc89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b1d42ac3a427bb084740a069b577d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3be4b5e724284f998093583529d1723e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:50:42.333249 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929794-4889-436f-97f2-84f98571cc89 service placement] REQUEST_METHOD: `GET` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:50:42.333531 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929794-4889-436f-97f2-84f98571cc89 service placement] SCRIPT_NAME: `/identity` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:50:42.333837 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929794-4889-436f-97f2-84f98571cc89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:50:42.335781 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.fernet_utils [None req-e0929794-4889-436f-97f2-84f98571cc89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:50:42.347690 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0929794-4889-436f-97f2-84f98571cc89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:50:42.349521 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0929794-4889-436f-97f2-84f98571cc89 service placement] RBAC: Authorization granted {{(pid=79139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:50:42.359861 dv-cinder-813228-4-iscsi devstack@keystone.service[79139]: [pid: 79139|app: 0|req: 1430/2879] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Dec 15 13:50:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)